-- Logs begin at Wed 2022-05-11 06:56:21 UTC, end at Wed 2022-05-11 08:00:41 UTC. -- May 11 07:23:50.933473 dv-cinder-836996-20-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 11 07:23:50.942389 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 07:23:50 2022] *** May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: nodename: dv-cinder-836996-20-iscsi May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: machine: x86_64 May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: clock source: unix May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: pcre jit disabled May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: detected number of CPU cores: 4 May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: current working directory: / May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: detected binary path: /usr/bin/uwsgi-core May 11 07:23:50.944410 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: your processes number limit is 47680 May 11 07:23:50.944971 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: your memory page size is 4096 bytes May 11 07:23:50.944971 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: detected max file descriptor number: 2048 May 11 07:23:50.944971 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: lock engine: pthread robust mutexes May 11 07:23:50.944971 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: thunder lock: enabled May 11 07:23:50.944971 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 11 07:23:50.944971 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 07:23:50.989944 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: Python main interpreter initialized at 0x55bbeea359c0 May 11 07:23:50.989944 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: python threads support enabled May 11 07:23:50.989944 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: your server socket listen backlog is limited to 100 connections May 11 07:23:50.989944 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: your mercy for graceful operations on workers is 90 seconds May 11 07:23:50.990307 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: mapped 403077 bytes (393 KB) for 2 cores May 11 07:23:50.990391 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: *** Operational MODE: preforking *** May 11 07:23:50.990633 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: *** uWSGI is running in multiple interpreter mode *** May 11 07:23:50.990633 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: spawned uWSGI master process (pid: 79902) May 11 07:23:50.990834 dv-cinder-836996-20-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 11 07:23:50.992893 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: spawned uWSGI worker 1 (pid: 79913, cores: 1) May 11 07:23:50.992893 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: spawned uWSGI worker 2 (pid: 79914, cores: 1) May 11 07:23:50.992893 dv-cinder-836996-20-iscsi devstack@keystone.service[79902]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 07:23:56.703439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:23:56.703439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: from cryptography.utils import int_from_bytes May 11 07:23:56.704208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:23:56.704208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: from cryptography.utils import int_from_bytes May 11 07:23:56.704808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:23:56.704808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: from cryptography.utils import int_from_bytes May 11 07:23:56.705183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 07:23:56.705183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: from cryptography.utils import int_from_bytes May 11 07:23:56.753700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 07:23:56.753849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 07:23:56.754023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 07:23:56.754122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] command line args: [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 07:23:56.754189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 07:23:56.754328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 07:23:56.754415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] command line args: [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 07:23:56.754477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ================================================================================ {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 07:23:56.754626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 07:23:56.754712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] admin_token = **** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.754772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ================================================================================ {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 07:23:56.755499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] config_dir = [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.755600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] admin_token = **** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.755661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.755723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] config_dir = [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.755785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] config_source = [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.755842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.756034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] debug = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.756129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] config_source = [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.756195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.758731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] debug = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.758731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.759174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.759374 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.759544 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.759744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.759937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.760136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.760364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.760549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.760779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] list_limit = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.760951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] list_limit = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.761151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] log_config_append = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.761378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] log_config_append = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.761583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.761749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.761942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] log_dir = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.762167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] log_dir = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.762332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] log_file = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.762556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] log_file = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.762721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.762919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.763118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.763319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.763482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.763651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.763783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.763954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.764086 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.764255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.764402 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.764551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.764688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.764817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.764988 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.765128 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.765269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.765399 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.765525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.765692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.765831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.765960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.766105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.766258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.766431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.766569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.766704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.766843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.766982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.767120 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.767250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.767378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.767516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] publish_errors = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.767650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] publish_errors = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.767778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.767910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.768047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.768175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.768399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.768540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.768693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.768884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.769096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.769234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.769363 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] standard_threads = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.769496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] standard_threads = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.769659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.769803 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.769939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.770073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.770202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.770329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.770463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] use_journal = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.770599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] use_journal = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.770745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] use_json = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.770880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] use_json = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.771008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] use_stderr = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.771140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] use_stderr = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.771269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] use_syslog = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.771408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] use_syslog = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.771543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.771677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 07:23:56.771804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.771937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.771937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.772187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.772317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.772450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.773959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.774973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.775947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.776998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.777949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.778954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.779996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780525 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.780955 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.781021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.781079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.781145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.781210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.781269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.781325 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.781382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.784131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.784388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.784612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.784842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.785049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.785241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.785461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.785720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.785931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.786160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.786356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.786548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.786735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.786959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.787167 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.787370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.787610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.787811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.788033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.788240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.788506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.788671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.788835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.788970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.789101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.789269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.789410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.789566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.789714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.789845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.790006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.790150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.790280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.790409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.790538 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.790667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.790796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.790937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.791067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.791197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.791355 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.791486 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.791626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.791769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.791909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.792048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.792180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.792310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.792438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.792574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.792704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.792841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.792972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.793101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.793230 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.793360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.793498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.793665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.793798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.793961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.794125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.794263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.794394 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.794532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.794663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.794792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.794921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.795050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.795050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] auth.external = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.795303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.795450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.795581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] auth.external = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.795581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.795825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.795825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.796128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.796262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] auth.password = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.796404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.796536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] auth.token = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.796666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] auth.password = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.796795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.796924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] auth.token = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.797054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.797206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.797338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.797468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.797690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.797825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.797955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.798097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.798234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.798391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.798632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.798781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.798924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] credential.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.799055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.799196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.799333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] credential.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.799463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.799595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.799732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.799863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.799993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.800123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.800252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.800383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801965 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.801965 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.802209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.802338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.802467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.802605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.802739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.802868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.802998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.803128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.803257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.803404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.803536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.803536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] federation.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.803791 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.803926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.804056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] federation.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.804194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.804334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.804464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.804593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.804722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.804853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.804853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.805273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.805273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.805522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.805522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.805791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.805791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.806073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.806073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.806317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.806317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.806561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.806561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.806816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.806816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.807073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.807202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.807331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.807331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.807585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.807585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.807829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.807959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.808088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.808088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.808345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.808345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.808588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.808733 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.808864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.808864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.809119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.809249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.809379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.809379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.809660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.809802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.809934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.810114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.810249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.810249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.810500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.810649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.810781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.810910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.811288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.811422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.811560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.811692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.811828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.811959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.812089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.812089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.812349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.812480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.812633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.812771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.812909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.813039 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.813178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.813308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.813438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.813594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.813734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.813865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.814006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.814137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.814275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.814407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.814547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.814676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.814814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.814944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.815073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.815201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.815331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.815460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.815596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.815727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.815857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.815995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.816126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.816906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.817048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.817180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.817315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.817447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.817595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.817730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.817872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.818004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.818133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.818262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.818392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.818522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.818660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.818801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.818938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.819068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.819197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.819326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.819464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.819595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.819724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.819854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.819982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.820111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.820253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.820384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.820515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.820655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.820785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.820915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.821053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.821185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.821314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.821450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.821599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.821735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.821878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.822009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.822146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.822278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.822417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.822548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.822686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.822827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.822968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.823099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.823235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.823365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.823503 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.823634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.823764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.823893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.824023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.824152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.824303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.824435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.824570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.824570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.824815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.824952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.825084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.825213 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.825341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.825470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.825705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.825856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.825989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.826145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.826279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.826279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.826524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.826524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.826778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.826907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.827037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.827166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.827296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.827433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.827564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.827693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.827824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.827966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.828103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.828241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.828373 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.828502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.828632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.828761 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.828891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.829028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.829028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.829274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.829404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.829533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.829686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.829837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.829971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.830100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.830230 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.830358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.830524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.830667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.830798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.830928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.831058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.831187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.831316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.831517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.831651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] resource.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.831819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] resource.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.831953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.832083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.832212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.832350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.832481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.832610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.832740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.832869 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.832998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.833137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.833268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.833398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.833551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.833690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.833820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.833960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.834092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.834222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.834351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] role.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.834480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] role.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.834610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] role.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.834746 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] role.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.834878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.835007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.835136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.835136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.835391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.835530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.835661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.835791 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.835921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.836057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.836191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.836330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.836460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.836589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.836718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.836847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.836977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.837124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.837256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.837386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.837515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.837706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.837847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.837978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.838109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.838238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.838369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.838369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.838621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.838621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.838876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.839006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.839137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.839266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.839405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.839537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.839666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.839796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.839925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.840055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.840193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.840324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.840454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.840592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.840722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.840851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.840989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.841120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.841250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.841378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.841508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.841708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.841867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.841999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.842129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.842258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.842388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.842528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.842683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.842927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.843085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.843227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.843358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.843493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.843634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.843765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] token.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.843894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.844024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.844153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] token.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.844282 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.844420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.844560 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.844691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.844821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.844950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.845967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.846901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847179 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.connection = **** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.connection = **** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.847958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.848931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849223 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849223 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 07:23:56.849587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 07:23:56.849587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 07:23:56.869687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.869918 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.870140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.870598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.870897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.871186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.879387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.880539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.907267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.907482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.908543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.908777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.960764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:56.961060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.012258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.012488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.012792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.013030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.077969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.078229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.078399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.078615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.078755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.078908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.079043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.079175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.079307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.079307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.079566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.079709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.102480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.102737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.102888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.103061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.103198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.103329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.103591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.103731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.103874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.104005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.104134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.104264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.104395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.115603 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.115773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.130028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.130231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.130366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.130512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.130657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.130832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.130964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.131094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.131233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.131366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.131496 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.131625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.131754 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79913) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.131884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 07:23:57.148435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.148651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 07:23:57.148802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.148945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 07:23:57.149083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.149234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 07:23:57.149370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.149504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.149675 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 07:23:57.149850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.149990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.150136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.150283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.150416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.150548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.150548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.161601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.161878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.162078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.162220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.162356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.162488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.162635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.162866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.170518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.171015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.173816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.174090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.174321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.174463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.174597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.174729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.174971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.175114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.175258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.175390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.175555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.176191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.176328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.176459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.176593 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.176726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.176860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.177003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.177138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.177281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.177415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.177606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.203714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.204501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.205318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.205618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.206170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.206451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.210895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.211172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.211448 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.211824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.212101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.212382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.218745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.219022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.219880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.220202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.224174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.224458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.224734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.225008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.225277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.225429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.225598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.225739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.225873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.226005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.226138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.226562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.226562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.226833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.226964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.227218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.245803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.246102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.246707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.247003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.250743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.251720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.254450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.254749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.255436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.255734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.259745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.260763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.263442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.264407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.267165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.267473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.267748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.268024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.268294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.268565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.270220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.270534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.270823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.271112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.271395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.271678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.290768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.291321 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.291410 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.291765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.291847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.292037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.292266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.292348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.300277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.300431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.302658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.302942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.303030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.303373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.306056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.306340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.306625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.306839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.306921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.307183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.307369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.307735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.308132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.308507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.321071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.321352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.321660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.321954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.322238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.322523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.322800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.323137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.323507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.323895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.324281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.324654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.325046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.325418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.341215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.343662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.344555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.347185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.348452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.350116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.351445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.351774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.352055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.352345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.353466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.355228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.355626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.356030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.359960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.361617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.364369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.365402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.365721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.366007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.366282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.366489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.369844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.370240 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.370627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.371007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.375505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.375809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.376095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.380694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.381098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.381485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.384120 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.384403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.384687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.384964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.385239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.385524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.385832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.386112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.386382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.386651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.386923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.387199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.387465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.387743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.390923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79913) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 07:23:57.391316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.391701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.392115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.392500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.392885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.393273 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.393686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.394060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.394459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.394830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.395209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.395587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.395978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79913) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 07:23:57.427639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bbeea359c0 pid: 79914 (default app) May 11 07:23:57.431321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa871-9203-41e6-8b33-2c5be723d2c7 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:23:57.431625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa871-9203-41e6-8b33-2c5be723d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:23:57.431916 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa871-9203-41e6-8b33-2c5be723d2c7 None None] PATH_INFO: `/v3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:23:57.436959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Wed May 11 07:23:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:23:57.437058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bbeea359c0 pid: 79913 (default app) May 11 07:24:05.375416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e746-a6df-4735-b914-1fd84f9d0f62 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:05.375990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e746-a6df-4735-b914-1fd84f9d0f62 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:05.375990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7e746-a6df-4735-b914-1fd84f9d0f62 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:05.377299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:05.385424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:05.385920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:05.386011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:05.416269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG oslo_db.sqlalchemy.engines [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:24:05.600144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG passlib.handlers.bcrypt [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79913) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 07:24:05.600568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG passlib.handlers.bcrypt [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79913) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 07:24:05.656030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:05.657579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:05.780398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1/3] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 07:24:05.952348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7e746-a6df-4735-b914-1fd84f9d0f62 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:05.985532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG oslo_db.sqlalchemy.engines [None req-60d7e746-a6df-4735-b914-1fd84f9d0f62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 07:24:06.110434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7e746-a6df-4735-b914-1fd84f9d0f62 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:06.115270 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471de7b-d2ba-473c-9f8e-58346da0aa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:06.115927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471de7b-d2ba-473c-9f8e-58346da0aa2c admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:06.116214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471de7b-d2ba-473c-9f8e-58346da0aa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:06.116493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471de7b-d2ba-473c-9f8e-58346da0aa2c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:06.124666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471de7b-d2ba-473c-9f8e-58346da0aa2c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:06.177065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d471de7b-d2ba-473c-9f8e-58346da0aa2c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 07:24:06.177403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471de7b-d2ba-473c-9f8e-58346da0aa2c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:06.187018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1324 bytes} [Wed May 11 07:24:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 07:24:06.192885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:06.206952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4b93d-ccc2-482b-aaf1-6b019eeb5041 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:06.211473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caa0d0-29da-4cd8-9ef2-4f5ac1950f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:06.212616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa0d0-29da-4cd8-9ef2-4f5ac1950f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:06.212905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa0d0-29da-4cd8-9ef2-4f5ac1950f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:06.213186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caa0d0-29da-4cd8-9ef2-4f5ac1950f44 admin admin] PATH_INFO: `/v3/projects/5da8d434269248bf956fab772dd66ddd` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:06.214703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caa0d0-29da-4cd8-9ef2-4f5ac1950f44 admin admin] RBAC: Authorizing `identity:get_project(project_id=5da8d434269248bf956fab772dd66ddd)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:06.266196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00caa0d0-29da-4cd8-9ef2-4f5ac1950f44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 07:24:06.266534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00caa0d0-29da-4cd8-9ef2-4f5ac1950f44 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:06.271101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 2/5] 10.222.0.36 () {56 vars in 1207 bytes} [Wed May 11 07:24:06 2022] GET /identity/v3/projects/5da8d434269248bf956fab772dd66ddd => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:08.447177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391f1b-1960-45d5-82fd-cda538b52ed9 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:08.447711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391f1b-1960-45d5-82fd-cda538b52ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:08.447711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391f1b-1960-45d5-82fd-cda538b52ed9 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:08.451850 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 4/6] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:08.457269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edad74-4076-4431-a080-56b9dc659396 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:08.457696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edad74-4076-4431-a080-56b9dc659396 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:08.457855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edad74-4076-4431-a080-56b9dc659396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:08.477666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-95edad74-4076-4431-a080-56b9dc659396 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:08.479163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-95edad74-4076-4431-a080-56b9dc659396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:08.486985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 07:24:08.509552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391f1b-1960-45d5-82fd-cda538b52ed9 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:08.521213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391f1b-1960-45d5-82fd-cda538b52ed9 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:08.525290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc48cd-94a1-4667-86c0-e8b023b621dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:08.525947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc48cd-94a1-4667-86c0-e8b023b621dd admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:08.526229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc48cd-94a1-4667-86c0-e8b023b621dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:08.526500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc48cd-94a1-4667-86c0-e8b023b621dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:08.533894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc48cd-94a1-4667-86c0-e8b023b621dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:08.536181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc48cd-94a1-4667-86c0-e8b023b621dd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:08.544566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1324 bytes} [Wed May 11 07:24:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:24:08.549806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edad74-4076-4431-a080-56b9dc659396 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:08.559224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edad74-4076-4431-a080-56b9dc659396 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:08.563867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb01c-9bf4-4a3d-b561-2b5b263125e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:08.564724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb01c-9bf4-4a3d-b561-2b5b263125e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:08.565010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb01c-9bf4-4a3d-b561-2b5b263125e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:08.565291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb01c-9bf4-4a3d-b561-2b5b263125e6 admin admin] PATH_INFO: `/v3/users/2752110942d445b6bd51fbda49f0d6b8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:08.566713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cb01c-9bf4-4a3d-b561-2b5b263125e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2752110942d445b6bd51fbda49f0d6b8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:08.568527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cb01c-9bf4-4a3d-b561-2b5b263125e6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:08.570115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 4/9] 10.222.0.36 () {56 vars in 1198 bytes} [Wed May 11 07:24:08 2022] GET /identity/v3/users/2752110942d445b6bd51fbda49f0d6b8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:10.823629 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8947fd-3754-4e42-9b8c-3ef5ff034643 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:10.824116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8947fd-3754-4e42-9b8c-3ef5ff034643 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:10.824116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8947fd-3754-4e42-9b8c-3ef5ff034643 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:10.825434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:10.830627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdd8a7-6a60-4376-9530-7fdb8b7f36e2 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:10.831005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdd8a7-6a60-4376-9530-7fdb8b7f36e2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:10.831194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdd8a7-6a60-4376-9530-7fdb8b7f36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:10.924168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab271-3983-481a-86e1-39455ac2f0e8 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:10.924452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab271-3983-481a-86e1-39455ac2f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:10.924729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab271-3983-481a-86e1-39455ac2f0e8 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:10.926157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 7/11] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:10.932006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:10.932297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:10.932574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:10.956486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-acfdd8a7-6a60-4376-9530-7fdb8b7f36e2 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:10.958223 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-acfdd8a7-6a60-4376-9530-7fdb8b7f36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:10.972513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG passlib.handlers.bcrypt [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79914) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 07:24:10.972935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG passlib.handlers.bcrypt [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79914) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 07:24:11.019835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:11.021403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:11.032885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 5/12] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:11.056263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdd8a7-6a60-4376-9530-7fdb8b7f36e2 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:11.118387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 8/13] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:11.140945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:11.152773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdd8a7-6a60-4376-9530-7fdb8b7f36e2 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:11.184393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5156d-ab43-4a75-b99c-1cabba1e55d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:11.185179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5156d-ab43-4a75-b99c-1cabba1e55d5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:11.185461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5156d-ab43-4a75-b99c-1cabba1e55d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:11.185762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5156d-ab43-4a75-b99c-1cabba1e55d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:11.197229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5156d-ab43-4a75-b99c-1cabba1e55d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-34d5156d-ab43-4a75-b99c-1cabba1e55d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:11.208470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:11.209648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:11.210441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 6/14] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:11.215491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5156d-ab43-4a75-b99c-1cabba1e55d5 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:11.235412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9fa9d-d383-4073-ab75-adde6e53e813 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:11.267584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dc417-c20e-43eb-b621-7327f6fa5de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:11.268468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dc417-c20e-43eb-b621-7327f6fa5de3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:11.268756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dc417-c20e-43eb-b621-7327f6fa5de3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:11.269058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dc417-c20e-43eb-b621-7327f6fa5de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:11.308627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5156d-ab43-4a75-b99c-1cabba1e55d5 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:11.334756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dc417-c20e-43eb-b621-7327f6fa5de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:11.336275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dc417-c20e-43eb-b621-7327f6fa5de3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:11.341564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:11.342225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:11.342510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:11.342787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:11.343526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:11.343831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:11.345203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:11.356923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 7/15] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:11.362399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:11.430007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:24:11.435457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dc417-c20e-43eb-b621-7327f6fa5de3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:11.457842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5feb02-421f-4b6c-b5f4-1114b223580d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:11.495944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84423-11ae-4a40-92b4-971ac8202d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:11.496840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84423-11ae-4a40-92b4-971ac8202d20 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:11.497119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84423-11ae-4a40-92b4-971ac8202d20 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:11.497387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c84423-11ae-4a40-92b4-971ac8202d20 None admin] PATH_INFO: `/v3/users/2752110942d445b6bd51fbda49f0d6b8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:11.498694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84423-11ae-4a40-92b4-971ac8202d20 None admin] RBAC: Authorizing `identity:get_user(user_id=2752110942d445b6bd51fbda49f0d6b8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:11.500193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c84423-11ae-4a40-92b4-971ac8202d20 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:11.502092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 8/17] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:11 2022] GET /identity/v3/users/2752110942d445b6bd51fbda49f0d6b8 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:11.507636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84423-11ae-4a40-92b4-971ac8202d20 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:11.602499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c84423-11ae-4a40-92b4-971ac8202d20 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:11.633969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cb94d-af77-4bc0-ab1c-88faa830b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:11.634753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cb94d-af77-4bc0-ab1c-88faa830b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:11.634884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dc417-c20e-43eb-b621-7327f6fa5de3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:11.635029 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cb94d-af77-4bc0-ab1c-88faa830b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:11.635301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cb94d-af77-4bc0-ab1c-88faa830b8d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:11.636458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cb94d-af77-4bc0-ab1c-88faa830b8d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:11.637910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cb94d-af77-4bc0-ab1c-88faa830b8d2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:11.639642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:11.645221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cb94d-af77-4bc0-ab1c-88faa830b8d2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:11.666921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:11.667719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:11.667998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:11.668277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:11.687516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:11.688917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:24:11.709002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:11.709867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:11.710651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:24:11.710651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:24:11.710651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:24:11.710651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:11.710651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:11.715988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:11.740577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cb94d-af77-4bc0-ab1c-88faa830b8d2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:11.772305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5f513-7036-48b9-93b1-ccec2d53d2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:11.772953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f513-7036-48b9-93b1-ccec2d53d2f1 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:11.773241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f513-7036-48b9-93b1-ccec2d53d2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:11.773520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f513-7036-48b9-93b1-ccec2d53d2f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:11.774380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5f513-7036-48b9-93b1-ccec2d53d2f1 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.domain.id=default, user.id=2752110942d445b6bd51fbda49f0d6b8) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:11.774696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5f513-7036-48b9-93b1-ccec2d53d2f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:11.776131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5f513-7036-48b9-93b1-ccec2d53d2f1 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:11.782600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1322 bytes} [Wed May 11 07:24:11 2022] GET /identity/v3/role_assignments?user.id=2752110942d445b6bd51fbda49f0d6b8&scope.domain.id=default&role.id=de114c58fdc8476ebab657e6f9359155 => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:11.810583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fded25c-8614-4c2f-9101-4d4a4115f007 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:11.845382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4c4f7-ccc6-4137-a6b1-40419da5e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:11.846103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4c4f7-ccc6-4137-a6b1-40419da5e25a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:11.846383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4c4f7-ccc6-4137-a6b1-40419da5e25a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:11.846657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4c4f7-ccc6-4137-a6b1-40419da5e25a None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:11.848130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4c4f7-ccc6-4137-a6b1-40419da5e25a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:11.848435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4c4f7-ccc6-4137-a6b1-40419da5e25a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:11.849895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4c4f7-ccc6-4137-a6b1-40419da5e25a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:11.868640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:14.727661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75951d9-d92d-4846-8c52-b205ee7edc95 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:14.728499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75951d9-d92d-4846-8c52-b205ee7edc95 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:14.728944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75951d9-d92d-4846-8c52-b205ee7edc95 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:14.730515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:14.734602 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec5f65-064e-47f4-a411-e2b3c0ab8bd7 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:14.735571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec5f65-064e-47f4-a411-e2b3c0ab8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:14.735992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec5f65-064e-47f4-a411-e2b3c0ab8bd7 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:14.737503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 12/23] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:14.739030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b2e0-96e4-430e-8ebd-a4027065712e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:14.739455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b2e0-96e4-430e-8ebd-a4027065712e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:14.739886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686b2e0-96e4-430e-8ebd-a4027065712e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:14.742680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bcbf3-a1d2-44b8-9d02-e77fccd3ea79 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:14.743216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bcbf3-a1d2-44b8-9d02-e77fccd3ea79 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:14.743700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bcbf3-a1d2-44b8-9d02-e77fccd3ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:14.761986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0686b2e0-96e4-430e-8ebd-a4027065712e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:14.763244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0686b2e0-96e4-430e-8ebd-a4027065712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:14.770758 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-098bcbf3-a1d2-44b8-9d02-e77fccd3ea79 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:14.772337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-098bcbf3-a1d2-44b8-9d02-e77fccd3ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:14.868502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:14.882057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:14.903372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686b2e0-96e4-430e-8ebd-a4027065712e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:14.917080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bcbf3-a1d2-44b8-9d02-e77fccd3ea79 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:15.040704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686b2e0-96e4-430e-8ebd-a4027065712e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:15.069477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bcbf3-a1d2-44b8-9d02-e77fccd3ea79 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:15.076547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052ad9d-fadb-4392-88bb-1ef38f894993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:15.077871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ad9d-fadb-4392-88bb-1ef38f894993 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.078320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ad9d-fadb-4392-88bb-1ef38f894993 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.078751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052ad9d-fadb-4392-88bb-1ef38f894993 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.080019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052ad9d-fadb-4392-88bb-1ef38f894993 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:15.082475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052ad9d-fadb-4392-88bb-1ef38f894993 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:15.105590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ff9cc-d356-48d6-98b7-a0935833d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:15.106913 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ff9cc-d356-48d6-98b7-a0935833d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.107325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ff9cc-d356-48d6-98b7-a0935833d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.107698 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ff9cc-d356-48d6-98b7-a0935833d9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.120309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ff9cc-d356-48d6-98b7-a0935833d9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:15.122058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ff9cc-d356-48d6-98b7-a0935833d9a6 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-db6ff9cc-d356-48d6-98b7-a0935833d9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:24:15.145161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:15.146142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:15.146948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:24:15.146948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:24:15.146948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:24:15.146948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:15.147296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 14/26] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:15.148970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa72a-679e-40cd-a831-aca72c454e37 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.149387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa72a-679e-40cd-a831-aca72c454e37 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.149778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa72a-679e-40cd-a831-aca72c454e37 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.151539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 15/27] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:15.152839 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31286fe4-c299-48ce-84b7-487838c0ccc7 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.153264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31286fe4-c299-48ce-84b7-487838c0ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.153713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31286fe4-c299-48ce-84b7-487838c0ccc7 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.155437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 16/28] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:15.156770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53062d56-8a68-4954-a9bb-691f4b063259 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.157184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53062d56-8a68-4954-a9bb-691f4b063259 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.157614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53062d56-8a68-4954-a9bb-691f4b063259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.175069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-53062d56-8a68-4954-a9bb-691f4b063259 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:15.176494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-53062d56-8a68-4954-a9bb-691f4b063259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:15.225833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 13/29] 10.222.0.36 () {60 vars in 1131 bytes} [Wed May 11 07:24:14 2022] POST /identity/v3/roles => generated 219 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:15.227203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052ad9d-fadb-4392-88bb-1ef38f894993 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:15.245642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:15.247017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b6ccd-f718-4e36-a3e7-6dc4f2d9d137 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.247306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b6ccd-f718-4e36-a3e7-6dc4f2d9d137 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.247582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b6ccd-f718-4e36-a3e7-6dc4f2d9d137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.265294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-061b6ccd-f718-4e36-a3e7-6dc4f2d9d137 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:15.266587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-061b6ccd-f718-4e36-a3e7-6dc4f2d9d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:15.336612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 18/31] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:15.337294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052ad9d-fadb-4392-88bb-1ef38f894993 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:15.337401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b6ccd-f718-4e36-a3e7-6dc4f2d9d137 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:15.374269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:15.375349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.375831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.376301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.377245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:15.377774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:15.380218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:15.399922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 14/32] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:15.401123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:15.443653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b6ccd-f718-4e36-a3e7-6dc4f2d9d137 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:15.493715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3780c9-3c96-4bae-93e4-80463258e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:15.494655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3780c9-3c96-4bae-93e4-80463258e8b7 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.494931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3780c9-3c96-4bae-93e4-80463258e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.495200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3780c9-3c96-4bae-93e4-80463258e8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.495958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3780c9-3c96-4bae-93e4-80463258e8b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:15.497480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3780c9-3c96-4bae-93e4-80463258e8b7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:15.537679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff1d0c-ee78-4871-b7ea-e0c079a9184c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:15.575668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9c25-1a8d-4a60-8676-c5ad90874436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:15.576838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9c25-1a8d-4a60-8676-c5ad90874436 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.577322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9c25-1a8d-4a60-8676-c5ad90874436 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.577891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b9c25-1a8d-4a60-8676-c5ad90874436 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.588681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b9c25-1a8d-4a60-8676-c5ad90874436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-f37b9c25-1a8d-4a60-8676-c5ad90874436 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:15.597051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:15.597904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:15.598620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:15.600945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 15/33] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:15.601956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9c25-1a8d-4a60-8676-c5ad90874436 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:15.639201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 19/34] 10.222.0.36 () {60 vars in 1131 bytes} [Wed May 11 07:24:15 2022] POST /identity/v3/roles => generated 225 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:15.640188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3780c9-3c96-4bae-93e4-80463258e8b7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:15.717317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b9c25-1a8d-4a60-8676-c5ad90874436 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:15.755193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086614d9-7a67-4065-b986-2ba7f7816c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:15.756725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086614d9-7a67-4065-b986-2ba7f7816c55 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.757217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086614d9-7a67-4065-b986-2ba7f7816c55 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.757727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086614d9-7a67-4065-b986-2ba7f7816c55 None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.758695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086614d9-7a67-4065-b986-2ba7f7816c55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:15.760455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086614d9-7a67-4065-b986-2ba7f7816c55 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:15.762421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3780c9-3c96-4bae-93e4-80463258e8b7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:15.803309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b6e3e-2e6e-4fc3-9789-9b5d7ce84c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:15.803996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6e3e-2e6e-4fc3-9789-9b5d7ce84c94 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.804280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6e3e-2e6e-4fc3-9789-9b5d7ce84c94 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.804552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6e3e-2e6e-4fc3-9789-9b5d7ce84c94 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.805613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b6e3e-2e6e-4fc3-9789-9b5d7ce84c94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:15.805929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b6e3e-2e6e-4fc3-9789-9b5d7ce84c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:15.807618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b6e3e-2e6e-4fc3-9789-9b5d7ce84c94 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:15.814397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 16/35] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:24:15 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:15.824578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 20/36] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:15.831193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086614d9-7a67-4065-b986-2ba7f7816c55 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:15.837564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9fcab-6aa1-4c74-ace1-abcf513eb170 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.837564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9fcab-6aa1-4c74-ace1-abcf513eb170 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.837801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9fcab-6aa1-4c74-ace1-abcf513eb170 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.839550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 21/37] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:15.847664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccefcc-2d47-4b5e-85b0-f50d0105741e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:15.847974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccefcc-2d47-4b5e-85b0-f50d0105741e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:15.848237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccefcc-2d47-4b5e-85b0-f50d0105741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:15.878224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d9ccefcc-2d47-4b5e-85b0-f50d0105741e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:15.879986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d9ccefcc-2d47-4b5e-85b0-f50d0105741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:15.996306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 22/38] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:16.021412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccefcc-2d47-4b5e-85b0-f50d0105741e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:16.023683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086614d9-7a67-4065-b986-2ba7f7816c55 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:16.068469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bcbe7-e0bf-4989-b3cf-434e8a744b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:16.069365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bcbe7-e0bf-4989-b3cf-434e8a744b53 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:16.069733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bcbe7-e0bf-4989-b3cf-434e8a744b53 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:16.070019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bcbe7-e0bf-4989-b3cf-434e8a744b53 None admin] PATH_INFO: `/v3/users/2752110942d445b6bd51fbda49f0d6b8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:16.071283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bcbe7-e0bf-4989-b3cf-434e8a744b53 None admin] RBAC: Authorizing `identity:get_user(user_id=2752110942d445b6bd51fbda49f0d6b8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:16.072789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bcbe7-e0bf-4989-b3cf-434e8a744b53 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:16.074681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 17/39] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:15 2022] GET /identity/v3/users/2752110942d445b6bd51fbda49f0d6b8 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:16.079929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bcbe7-e0bf-4989-b3cf-434e8a744b53 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:16.138994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccefcc-2d47-4b5e-85b0-f50d0105741e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:16.181997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0569f1-0a36-4c5a-b321-8fdc60977b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:16.182679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0569f1-0a36-4c5a-b321-8fdc60977b6e None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:16.182967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0569f1-0a36-4c5a-b321-8fdc60977b6e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:16.183250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0569f1-0a36-4c5a-b321-8fdc60977b6e None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:16.184012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0569f1-0a36-4c5a-b321-8fdc60977b6e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:16.185430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0569f1-0a36-4c5a-b321-8fdc60977b6e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:16.200512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 23/40] 10.222.0.36 () {60 vars in 1131 bytes} [Wed May 11 07:24:16 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:24:16.202310 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bcbe7-e0bf-4989-b3cf-434e8a744b53 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:16.243704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf903d6a-bcf3-4928-8e18-d7fc0a6af5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:16.244542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903d6a-bcf3-4928-8e18-d7fc0a6af5fe None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:16.244910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903d6a-bcf3-4928-8e18-d7fc0a6af5fe None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:16.245217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903d6a-bcf3-4928-8e18-d7fc0a6af5fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:16.246688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf903d6a-bcf3-4928-8e18-d7fc0a6af5fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:16.248311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf903d6a-bcf3-4928-8e18-d7fc0a6af5fe None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:16.255012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 18/41] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:16.256755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0569f1-0a36-4c5a-b321-8fdc60977b6e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:16.366248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0569f1-0a36-4c5a-b321-8fdc60977b6e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:16.400490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bc756-16fb-49e0-b050-530e1091f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:16.401299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bc756-16fb-49e0-b050-530e1091f551 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:16.401614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bc756-16fb-49e0-b050-530e1091f551 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:16.401905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bc756-16fb-49e0-b050-530e1091f551 None admin] PATH_INFO: `/v3/domains/default/users/2752110942d445b6bd51fbda49f0d6b8/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:16.404339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bc756-16fb-49e0-b050-530e1091f551 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2752110942d445b6bd51fbda49f0d6b8, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:16.405902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bc756-16fb-49e0-b050-530e1091f551 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:16.420880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a8f3b-fb49-4f1b-a574-67c78a61fcf0 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:16.421165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a8f3b-fb49-4f1b-a574-67c78a61fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:16.421445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a8f3b-fb49-4f1b-a574-67c78a61fcf0 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:16.422943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 19/42] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:16.423106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 24/43] 10.222.0.36 () {58 vars in 1361 bytes} [Wed May 11 07:24:16 2022] PUT /identity/v3/domains/default/users/2752110942d445b6bd51fbda49f0d6b8/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:24:16.428709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74111a-8e17-4b75-b410-dbf7d7bff367 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:16.429052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74111a-8e17-4b75-b410-dbf7d7bff367 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:16.429468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74111a-8e17-4b75-b410-dbf7d7bff367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:16.447701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5d74111a-8e17-4b75-b410-dbf7d7bff367 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:16.449304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5d74111a-8e17-4b75-b410-dbf7d7bff367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:16.523152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 20/44] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:16.546653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bc756-16fb-49e0-b050-530e1091f551 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:16.646233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bc756-16fb-49e0-b050-530e1091f551 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:16.677103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41478c37-756d-4e46-b31f-fb1f94d0525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:16.677983 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478c37-756d-4e46-b31f-fb1f94d0525a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:16.678268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478c37-756d-4e46-b31f-fb1f94d0525a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:16.678542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41478c37-756d-4e46-b31f-fb1f94d0525a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:16.679694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478c37-756d-4e46-b31f-fb1f94d0525a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:16.681157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41478c37-756d-4e46-b31f-fb1f94d0525a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:16.682817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 25/45] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:16.688666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74111a-8e17-4b75-b410-dbf7d7bff367 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:16.782025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74111a-8e17-4b75-b410-dbf7d7bff367 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:16.814322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb73f7-c0db-4c58-8492-80d33241b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:16.814981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb73f7-c0db-4c58-8492-80d33241b3ff None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:16.815264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb73f7-c0db-4c58-8492-80d33241b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:16.815535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb73f7-c0db-4c58-8492-80d33241b3ff None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:16.816764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb73f7-c0db-4c58-8492-80d33241b3ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:16.818237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb73f7-c0db-4c58-8492-80d33241b3ff None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:16.842385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 21/46] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:24:16 2022] POST /identity/v3/projects => generated 312 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:18.657296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4de3f4-0376-4808-82c2-8ca7fe3ec0e5 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:18.657830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4de3f4-0376-4808-82c2-8ca7fe3ec0e5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:18.657911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4de3f4-0376-4808-82c2-8ca7fe3ec0e5 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:18.659244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 26/47] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:18.664610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb548-2b32-4e84-8ae4-ee1f1fd14408 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:18.665003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb548-2b32-4e84-8ae4-ee1f1fd14408 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:18.665175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabb548-2b32-4e84-8ae4-ee1f1fd14408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:18.681983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3cabb548-2b32-4e84-8ae4-ee1f1fd14408 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:18.683355 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3cabb548-2b32-4e84-8ae4-ee1f1fd14408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:18.748741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 22/48] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:18.772351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4de3f4-0376-4808-82c2-8ca7fe3ec0e5 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:18.870488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4de3f4-0376-4808-82c2-8ca7fe3ec0e5 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:18.909964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0859-d75e-4bd2-ac19-c6462b836657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:18.910784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0859-d75e-4bd2-ac19-c6462b836657 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:18.911075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0859-d75e-4bd2-ac19-c6462b836657 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:18.911358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0859-d75e-4bd2-ac19-c6462b836657 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:18.922321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0859-d75e-4bd2-ac19-c6462b836657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-d83b0859-d75e-4bd2-ac19-c6462b836657 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:18.931780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:18.932656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:18.933385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 27/49] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:18.939258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb548-2b32-4e84-8ae4-ee1f1fd14408 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:19.031604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabb548-2b32-4e84-8ae4-ee1f1fd14408 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:19.062964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb90d-cccc-4fc9-bcae-643bc1abc420 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:19.063257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb90d-cccc-4fc9-bcae-643bc1abc420 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:19.063538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb90d-cccc-4fc9-bcae-643bc1abc420 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:19.064532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:19.064910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 28/50] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:19.065259 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:19.065564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:19.065891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:19.066713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:19.067033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:19.068489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:19.069895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95cd1e-22f1-4a67-b5f9-fad51bce0281 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:19.070191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95cd1e-22f1-4a67-b5f9-fad51bce0281 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:19.070471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95cd1e-22f1-4a67-b5f9-fad51bce0281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:19.076746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 23/51] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:19.081953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:19.087097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0d95cd1e-22f1-4a67-b5f9-fad51bce0281 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:19.088277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0d95cd1e-22f1-4a67-b5f9-fad51bce0281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:19.151051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 29/52] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:19.173683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95cd1e-22f1-4a67-b5f9-fad51bce0281 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:19.174874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b839c7-4793-4140-be21-0f90df47e075 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:19.206835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda899b-9dcc-4d74-8b01-cbe8a91eb5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:19.207725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda899b-9dcc-4d74-8b01-cbe8a91eb5ad None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:19.208007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda899b-9dcc-4d74-8b01-cbe8a91eb5ad None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:19.208280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda899b-9dcc-4d74-8b01-cbe8a91eb5ad None admin] PATH_INFO: `/v3/users/2752110942d445b6bd51fbda49f0d6b8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:19.209479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda899b-9dcc-4d74-8b01-cbe8a91eb5ad None admin] RBAC: Authorizing `identity:get_user(user_id=2752110942d445b6bd51fbda49f0d6b8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:19.210957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda899b-9dcc-4d74-8b01-cbe8a91eb5ad None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:19.212585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 24/53] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:19 2022] GET /identity/v3/users/2752110942d445b6bd51fbda49f0d6b8 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:19.217879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda899b-9dcc-4d74-8b01-cbe8a91eb5ad None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:19.273062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95cd1e-22f1-4a67-b5f9-fad51bce0281 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:19.305116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44211f-8c85-48fc-aac5-088dea0c6a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:19.305878 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44211f-8c85-48fc-aac5-088dea0c6a83 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:19.306169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44211f-8c85-48fc-aac5-088dea0c6a83 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:19.306450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44211f-8c85-48fc-aac5-088dea0c6a83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:19.307637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44211f-8c85-48fc-aac5-088dea0c6a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:19.309104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44211f-8c85-48fc-aac5-088dea0c6a83 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:19.311057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 30/54] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:19.313836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda899b-9dcc-4d74-8b01-cbe8a91eb5ad None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:19.316564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44211f-8c85-48fc-aac5-088dea0c6a83 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:19.345449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271cc6-a5d3-4e37-977a-997fcdba7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:19.346263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271cc6-a5d3-4e37-977a-997fcdba7264 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:19.346548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271cc6-a5d3-4e37-977a-997fcdba7264 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:19.346823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24271cc6-a5d3-4e37-977a-997fcdba7264 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:19.348569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24271cc6-a5d3-4e37-977a-997fcdba7264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:19.350093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24271cc6-a5d3-4e37-977a-997fcdba7264 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:19.351702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 25/55] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:19.357213 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271cc6-a5d3-4e37-977a-997fcdba7264 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:19.409491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44211f-8c85-48fc-aac5-088dea0c6a83 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:19.441888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd9035-0bfc-44d6-992d-af90bd767142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:19.442545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9035-0bfc-44d6-992d-af90bd767142 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:19.442842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9035-0bfc-44d6-992d-af90bd767142 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:19.443103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9035-0bfc-44d6-992d-af90bd767142 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:19.443805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd9035-0bfc-44d6-992d-af90bd767142 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:19.445246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd9035-0bfc-44d6-992d-af90bd767142 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:19.449135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24271cc6-a5d3-4e37-977a-997fcdba7264 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:19.473734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 31/56] 10.222.0.36 () {60 vars in 1140 bytes} [Wed May 11 07:24:19 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:24:19.490721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bec0a1-8c6a-4e78-9543-9a16d76125a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:19.491534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec0a1-8c6a-4e78-9543-9a16d76125a5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:19.491916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec0a1-8c6a-4e78-9543-9a16d76125a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:19.492264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bec0a1-8c6a-4e78-9543-9a16d76125a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:19.493196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec0a1-8c6a-4e78-9543-9a16d76125a5 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.domain.id=default, user.id=2752110942d445b6bd51fbda49f0d6b8) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:19.493624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec0a1-8c6a-4e78-9543-9a16d76125a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:19.495203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bec0a1-8c6a-4e78-9543-9a16d76125a5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:19.501848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 26/57] 10.222.0.36 () {56 vars in 1322 bytes} [Wed May 11 07:24:19 2022] GET /identity/v3/role_assignments?user.id=2752110942d445b6bd51fbda49f0d6b8&scope.domain.id=default&role.id=de114c58fdc8476ebab657e6f9359155 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:21.707433 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00ac9-97e8-4fb6-b326-60bfa377dcd0 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:21.707929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00ac9-97e8-4fb6-b326-60bfa377dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:21.708012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f00ac9-97e8-4fb6-b326-60bfa377dcd0 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:21.709367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 32/58] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:21.714628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be342b-c86d-41cc-8a12-361aa239ab29 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:21.715023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be342b-c86d-41cc-8a12-361aa239ab29 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:21.715189 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be342b-c86d-41cc-8a12-361aa239ab29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:21.731573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e9be342b-c86d-41cc-8a12-361aa239ab29 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:21.732760 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e9be342b-c86d-41cc-8a12-361aa239ab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:21.795000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 27/59] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:21.820538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f00ac9-97e8-4fb6-b326-60bfa377dcd0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:21.921264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f00ac9-97e8-4fb6-b326-60bfa377dcd0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:21.952882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bf837-03e5-4d85-9477-dba3fa436c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:21.953699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf837-03e5-4d85-9477-dba3fa436c1e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:21.953988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf837-03e5-4d85-9477-dba3fa436c1e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:21.954266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf837-03e5-4d85-9477-dba3fa436c1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:21.955442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf837-03e5-4d85-9477-dba3fa436c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:21.956936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf837-03e5-4d85-9477-dba3fa436c1e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:21.958566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 33/60] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:21.963979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be342b-c86d-41cc-8a12-361aa239ab29 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:22.055163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be342b-c86d-41cc-8a12-361aa239ab29 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:22.086182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5590f49-22c9-4abd-a475-d0cc28d4900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:22.086833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5590f49-22c9-4abd-a475-d0cc28d4900d None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:22.087126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5590f49-22c9-4abd-a475-d0cc28d4900d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:22.087403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5590f49-22c9-4abd-a475-d0cc28d4900d None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:22.088104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5590f49-22c9-4abd-a475-d0cc28d4900d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:22.089532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5590f49-22c9-4abd-a475-d0cc28d4900d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:22.113519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 28/61] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:24:21 2022] POST /identity/v3/users => generated 275 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:25.527813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecc25-b3ee-4dc9-be45-34886b2699d2 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:25.528322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecc25-b3ee-4dc9-be45-34886b2699d2 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:25.528393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecc25-b3ee-4dc9-be45-34886b2699d2 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:25.529820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 34/62] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:25.541824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e289f-2e2d-4b1c-a181-d040c48b0d9e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:25.542324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e289f-2e2d-4b1c-a181-d040c48b0d9e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:25.542397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e289f-2e2d-4b1c-a181-d040c48b0d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:25.548248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0b19-2b9d-4164-8fc1-80fcfea5e4fa None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:25.548792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0b19-2b9d-4164-8fc1-80fcfea5e4fa None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:25.549264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d0b19-2b9d-4164-8fc1-80fcfea5e4fa None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:25.551408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 35/63] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:25.563212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-470e289f-2e2d-4b1c-a181-d040c48b0d9e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:25.564939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9ac9-54fa-422c-b0ff-f3f42955feb3 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:25.567052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-470e289f-2e2d-4b1c-a181-d040c48b0d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:25.567564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9ac9-54fa-422c-b0ff-f3f42955feb3 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:25.568049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df9ac9-54fa-422c-b0ff-f3f42955feb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:25.600173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-81df9ac9-54fa-422c-b0ff-f3f42955feb3 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:25.602925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-81df9ac9-54fa-422c-b0ff-f3f42955feb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:25.679889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 29/64] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:25.694892 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 36/65] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:25.702806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e289f-2e2d-4b1c-a181-d040c48b0d9e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:25.743594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df9ac9-54fa-422c-b0ff-f3f42955feb3 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:25.806052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e289f-2e2d-4b1c-a181-d040c48b0d9e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:25.839900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c4010-9336-46b8-ba1c-6c9cf6176a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:25.840623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c4010-9336-46b8-ba1c-6c9cf6176a19 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:25.840907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c4010-9336-46b8-ba1c-6c9cf6176a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:25.841181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c4010-9336-46b8-ba1c-6c9cf6176a19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:25.848929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df9ac9-54fa-422c-b0ff-f3f42955feb3 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:25.852040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c4010-9336-46b8-ba1c-6c9cf6176a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5f3c4010-9336-46b8-ba1c-6c9cf6176a19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:25.859879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:25.860915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:25.861904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:25.869002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 30/66] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:25.870559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fdfa5-bbe7-4774-ad61-3aa04c2908b6 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:25.870982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fdfa5-bbe7-4774-ad61-3aa04c2908b6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:25.871411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fdfa5-bbe7-4774-ad61-3aa04c2908b6 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:25.872850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 31/67] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:25.874140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fdfa5-bbe7-4774-ad61-3aa04c2908b6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:25.887913 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb568-f29c-40cb-b752-61e738465a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:25.888724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb568-f29c-40cb-b752-61e738465a04 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:25.889008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb568-f29c-40cb-b752-61e738465a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:25.889339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb568-f29c-40cb-b752-61e738465a04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:25.899838 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb568-f29c-40cb-b752-61e738465a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-04aeb568-f29c-40cb-b752-61e738465a04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:25.907840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:25.908857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:25.910206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:25.912046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 37/68] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:25.913375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc1f13-86df-4e1c-88f1-3b2ac381814f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:25.913880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc1f13-86df-4e1c-88f1-3b2ac381814f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:25.914293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc1f13-86df-4e1c-88f1-3b2ac381814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:25.931456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-bddc1f13-86df-4e1c-88f1-3b2ac381814f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:25.932823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bddc1f13-86df-4e1c-88f1-3b2ac381814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:25.976773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fdfa5-bbe7-4774-ad61-3aa04c2908b6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:25.998495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 38/69] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:25.999505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc1f13-86df-4e1c-88f1-3b2ac381814f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.028052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686f14-4a67-4cbb-bd8c-88e72b7b979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.028935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686f14-4a67-4cbb-bd8c-88e72b7b979c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.029386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686f14-4a67-4cbb-bd8c-88e72b7b979c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.029820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686f14-4a67-4cbb-bd8c-88e72b7b979c None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.030710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29686f14-4a67-4cbb-bd8c-88e72b7b979c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:26.031173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29686f14-4a67-4cbb-bd8c-88e72b7b979c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.032704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29686f14-4a67-4cbb-bd8c-88e72b7b979c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.041948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 32/70] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:26.043632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443e5e-f69b-4fed-abcc-d74db9869eff None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.043928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443e5e-f69b-4fed-abcc-d74db9869eff None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.044205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed443e5e-f69b-4fed-abcc-d74db9869eff None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.045457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 33/71] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:26.046293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed443e5e-f69b-4fed-abcc-d74db9869eff None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.108722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc1f13-86df-4e1c-88f1-3b2ac381814f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.146510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.147185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.147473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.147752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.148505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:26.148818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.149495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed443e5e-f69b-4fed-abcc-d74db9869eff None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.150361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.163908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 39/72] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:26.163908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.188047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00faa15-11c7-4a68-b24c-3e106cbd3bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.188863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00faa15-11c7-4a68-b24c-3e106cbd3bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.189144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00faa15-11c7-4a68-b24c-3e106cbd3bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.189695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00faa15-11c7-4a68-b24c-3e106cbd3bf3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.200695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00faa15-11c7-4a68-b24c-3e106cbd3bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-d00faa15-11c7-4a68-b24c-3e106cbd3bf3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:26.209401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:26.210401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:26.211122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 34/73] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:26.214305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950046f-c2bf-4101-8280-ddc97c999525 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.214895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950046f-c2bf-4101-8280-ddc97c999525 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.215336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950046f-c2bf-4101-8280-ddc97c999525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.232012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e950046f-c2bf-4101-8280-ddc97c999525 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:26.233179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e950046f-c2bf-4101-8280-ddc97c999525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:26.266517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7cd15-cf24-446c-810e-2d3c0fda70f8 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.296035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 35/74] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:26.305729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950046f-c2bf-4101-8280-ddc97c999525 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.305835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa234a-5a01-450c-94ee-fe8528b47c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.305835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa234a-5a01-450c-94ee-fe8528b47c4b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.305835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa234a-5a01-450c-94ee-fe8528b47c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.305835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa234a-5a01-450c-94ee-fe8528b47c4b None admin] PATH_INFO: `/v3/users/2752110942d445b6bd51fbda49f0d6b8` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.306154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa234a-5a01-450c-94ee-fe8528b47c4b None admin] RBAC: Authorizing `identity:get_user(user_id=2752110942d445b6bd51fbda49f0d6b8)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.306154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa234a-5a01-450c-94ee-fe8528b47c4b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.306154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 40/75] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/users/2752110942d445b6bd51fbda49f0d6b8 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:26.306154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa234a-5a01-450c-94ee-fe8528b47c4b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.396968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950046f-c2bf-4101-8280-ddc97c999525 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.403911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa234a-5a01-450c-94ee-fe8528b47c4b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.428544 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09ed5f-195d-4d82-9b61-cb5eb6390815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.429481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ed5f-195d-4d82-9b61-cb5eb6390815 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.429803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ed5f-195d-4d82-9b61-cb5eb6390815 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.430081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09ed5f-195d-4d82-9b61-cb5eb6390815 None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.434549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.435212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.435496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.435772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.436514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:26.437078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.438552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.443458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09ed5f-195d-4d82-9b61-cb5eb6390815 None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.444892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09ed5f-195d-4d82-9b61-cb5eb6390815 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.446559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 36/76] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:26.446644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 41/77] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:26.447430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.447831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a6a9-507e-4d3b-9c2e-1002a4ab082d None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.448172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a6a9-507e-4d3b-9c2e-1002a4ab082d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.448387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84a6a9-507e-4d3b-9c2e-1002a4ab082d None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.454805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 37/78] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:26.454805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84a6a9-507e-4d3b-9c2e-1002a4ab082d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.542095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf9a72-e1f2-420f-86f4-1c759a1faead None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.552096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84a6a9-507e-4d3b-9c2e-1002a4ab082d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.573236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19510fda-e5b8-4446-abf0-c7001d5314de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.573918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510fda-e5b8-4446-abf0-c7001d5314de None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.574203 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510fda-e5b8-4446-abf0-c7001d5314de None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.574476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510fda-e5b8-4446-abf0-c7001d5314de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.584574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b28d8e-7ec6-47cd-9970-e60e23b9a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.585348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28d8e-7ec6-47cd-9970-e60e23b9a7ec None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.585663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28d8e-7ec6-47cd-9970-e60e23b9a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.585939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28d8e-7ec6-47cd-9970-e60e23b9a7ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.587088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b28d8e-7ec6-47cd-9970-e60e23b9a7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.588537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b28d8e-7ec6-47cd-9970-e60e23b9a7ec None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.590161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 38/79] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:26.594644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b28d8e-7ec6-47cd-9970-e60e23b9a7ec None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.637058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19510fda-e5b8-4446-abf0-c7001d5314de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.638553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19510fda-e5b8-4446-abf0-c7001d5314de None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.681615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b28d8e-7ec6-47cd-9970-e60e23b9a7ec None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.714731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5d4d8-ebce-4e4e-9701-82ca6c32b301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.715363 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5d4d8-ebce-4e4e-9701-82ca6c32b301 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.715647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5d4d8-ebce-4e4e-9701-82ca6c32b301 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.715922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5d4d8-ebce-4e4e-9701-82ca6c32b301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.728396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 42/80] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:26.728396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644fd03-003a-4ee1-8a78-019a9250706b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.728396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644fd03-003a-4ee1-8a78-019a9250706b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.728396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644fd03-003a-4ee1-8a78-019a9250706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.747239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1644fd03-003a-4ee1-8a78-019a9250706b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:26.748428 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1644fd03-003a-4ee1-8a78-019a9250706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:26.779303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5d4d8-ebce-4e4e-9701-82ca6c32b301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.780767 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5d4d8-ebce-4e4e-9701-82ca6c32b301 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.809641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 43/81] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:26.810395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644fd03-003a-4ee1-8a78-019a9250706b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.873710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 39/82] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:26.874536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5d4d8-ebce-4e4e-9701-82ca6c32b301 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.904685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644fd03-003a-4ee1-8a78-019a9250706b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.936196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0352c-72b1-4dcd-bcf9-04b51ed19996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.937322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0352c-72b1-4dcd-bcf9-04b51ed19996 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.937637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0352c-72b1-4dcd-bcf9-04b51ed19996 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.937909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0352c-72b1-4dcd-bcf9-04b51ed19996 None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.939091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0352c-72b1-4dcd-bcf9-04b51ed19996 None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:26.940590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0352c-72b1-4dcd-bcf9-04b51ed19996 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:26.947318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 44/83] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:26.947318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0352c-72b1-4dcd-bcf9-04b51ed19996 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:26.966016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5d4d8-ebce-4e4e-9701-82ca6c32b301 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:26.997699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef256-a349-46e3-b79a-bdaa0f8be705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:26.998363 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef256-a349-46e3-b79a-bdaa0f8be705 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:26.998645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef256-a349-46e3-b79a-bdaa0f8be705 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:26.998923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcef256-a349-46e3-b79a-bdaa0f8be705 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:26.999625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef256-a349-46e3-b79a-bdaa0f8be705 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.001072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcef256-a349-46e3-b79a-bdaa0f8be705 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.019776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 40/84] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:24:26 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:27.020577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef256-a349-46e3-b79a-bdaa0f8be705 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.034727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0352c-72b1-4dcd-bcf9-04b51ed19996 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.071682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b6b4-b07e-47ff-a1d4-98029d487bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.072948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b6b4-b07e-47ff-a1d4-98029d487bbc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.073373 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b6b4-b07e-47ff-a1d4-98029d487bbc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.073831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9b6b4-b07e-47ff-a1d4-98029d487bbc None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.075277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9b6b4-b07e-47ff-a1d4-98029d487bbc None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.076930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9b6b4-b07e-47ff-a1d4-98029d487bbc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.078974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 45/85] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:26 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:27.079953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b6b4-b07e-47ff-a1d4-98029d487bbc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.125971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcef256-a349-46e3-b79a-bdaa0f8be705 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.160277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5a812-b25e-4867-9c81-c49647caa6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.161095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5a812-b25e-4867-9c81-c49647caa6b8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.161382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5a812-b25e-4867-9c81-c49647caa6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.161690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5a812-b25e-4867-9c81-c49647caa6b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.172636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5a812-b25e-4867-9c81-c49647caa6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-45e5a812-b25e-4867-9c81-c49647caa6b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:27.181204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:27.182251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:27.183160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:27.187570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 41/86] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:27.188515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5a812-b25e-4867-9c81-c49647caa6b8 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.195478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9b6b4-b07e-47ff-a1d4-98029d487bbc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.230719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da82b8-c37c-4a78-8a79-f4acc3a8c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.231587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da82b8-c37c-4a78-8a79-f4acc3a8c72f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.231872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da82b8-c37c-4a78-8a79-f4acc3a8c72f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.232151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da82b8-c37c-4a78-8a79-f4acc3a8c72f None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.233329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da82b8-c37c-4a78-8a79-f4acc3a8c72f None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.234801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da82b8-c37c-4a78-8a79-f4acc3a8c72f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.236640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 46/87] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:27.241071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da82b8-c37c-4a78-8a79-f4acc3a8c72f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.291268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5a812-b25e-4867-9c81-c49647caa6b8 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.326587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4b2d-656c-49b3-9834-9493a1061acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.327193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4b2d-656c-49b3-9834-9493a1061acb None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.327464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4b2d-656c-49b3-9834-9493a1061acb None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.327745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4b2d-656c-49b3-9834-9493a1061acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.355181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da82b8-c37c-4a78-8a79-f4acc3a8c72f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.391538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.392277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.392537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.392814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.393784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=52ce4f52f95b46479b0949667e03c0d3, user.id=2752110942d445b6bd51fbda49f0d6b8) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:27.394103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.395550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.399526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4b2d-656c-49b3-9834-9493a1061acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.401162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4b2d-656c-49b3-9834-9493a1061acb None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.403453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 47/88] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/role_assignments?user.id=2752110942d445b6bd51fbda49f0d6b8&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=de114c58fdc8476ebab657e6f9359155 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:27.404169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.507411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 42/89] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:27.508113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4b2d-656c-49b3-9834-9493a1061acb None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.576960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdf040-1dc9-46f5-8c81-944f4ef70e25 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.614012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4b2d-656c-49b3-9834-9493a1061acb None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.640346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.641293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.641742 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.642156 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.643128 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:27.644115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.645682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.656240 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.658148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.658437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.658711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.660127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] RBAC: Adding query filter params (role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=52ce4f52f95b46479b0949667e03c0d3, user.id=92deee10b3eb491899613162290b0a5b) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:27.660443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.661959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.662865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 48/90] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:27.663766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.674085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 43/91] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/role_assignments?user.id=92deee10b3eb491899613162290b0a5b&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:27.679237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.814452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c716c-c987-4fb9-bd8f-9d703960e705 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.851611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f2002-7fe2-408a-8013-5bcf724f61ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.852438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2002-7fe2-408a-8013-5bcf724f61ef None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.852729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2002-7fe2-408a-8013-5bcf724f61ef None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.853008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f2002-7fe2-408a-8013-5bcf724f61ef None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.854372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f2002-7fe2-408a-8013-5bcf724f61ef None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.855868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f2002-7fe2-408a-8013-5bcf724f61ef None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.857817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 44/92] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:27.866776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f2002-7fe2-408a-8013-5bcf724f61ef None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:27.890238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6953d7-d310-4b53-94bb-aa369e7f7439 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:27.966117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72ac25-0b39-42ad-85d2-f0f4be8d84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:27.967012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ac25-0b39-42ad-85d2-f0f4be8d84ed None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:27.967294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ac25-0b39-42ad-85d2-f0f4be8d84ed None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:27.967570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ac25-0b39-42ad-85d2-f0f4be8d84ed None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:27.969037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72ac25-0b39-42ad-85d2-f0f4be8d84ed None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:27.970528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72ac25-0b39-42ad-85d2-f0f4be8d84ed None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:27.977279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 49/93] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:27.978166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72ac25-0b39-42ad-85d2-f0f4be8d84ed None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:28.053861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f2002-7fe2-408a-8013-5bcf724f61ef None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:28.124542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d63139-dd10-4252-a3fd-936469a04333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:28.125123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d63139-dd10-4252-a3fd-936469a04333 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:28.126826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d63139-dd10-4252-a3fd-936469a04333 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:28.127078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d63139-dd10-4252-a3fd-936469a04333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:28.138675 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72ac25-0b39-42ad-85d2-f0f4be8d84ed None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:28.178530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:28.179653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:28.180034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:28.180320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:28.181157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] RBAC: Adding query filter params (role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=52ce4f52f95b46479b0949667e03c0d3, user.id=92deee10b3eb491899613162290b0a5b) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:28.181645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:28.183494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:28.192266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 50/94] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/role_assignments?user.id=92deee10b3eb491899613162290b0a5b&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=aa78a08951eb49f78aeda141988844de => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:28.257035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d63139-dd10-4252-a3fd-936469a04333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:28.258894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d63139-dd10-4252-a3fd-936469a04333 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:28.388357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 45/95] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:24:28.394110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:28.519029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ace307-45dc-4c27-96a4-33ecfe51cf43 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:28.562521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0f0d8-91ab-4ad6-b567-64d3eb6115dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:28.563415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f0d8-91ab-4ad6-b567-64d3eb6115dc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:28.563702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f0d8-91ab-4ad6-b567-64d3eb6115dc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:28.563976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0f0d8-91ab-4ad6-b567-64d3eb6115dc None admin] PATH_INFO: `/v3/projects/43dd1ab24cb34a14ae46f0007b67608e` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:28.565218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0f0d8-91ab-4ad6-b567-64d3eb6115dc None admin] RBAC: Authorizing `identity:get_project(project_id=43dd1ab24cb34a14ae46f0007b67608e)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:28.567275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0f0d8-91ab-4ad6-b567-64d3eb6115dc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:28.569020 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 51/96] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:28 2022] GET /identity/v3/projects/43dd1ab24cb34a14ae46f0007b67608e => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:28.575168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d63139-dd10-4252-a3fd-936469a04333 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:28.691574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d63139-dd10-4252-a3fd-936469a04333 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:28.726270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ce2db-4ef4-4cdc-ad47-c4f1b734e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:28.727293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce2db-4ef4-4cdc-ad47-c4f1b734e390 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:28.727768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce2db-4ef4-4cdc-ad47-c4f1b734e390 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:28.728228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce2db-4ef4-4cdc-ad47-c4f1b734e390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:28.729271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce2db-4ef4-4cdc-ad47-c4f1b734e390 None admin] RBAC: Adding query filter params (role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=43dd1ab24cb34a14ae46f0007b67608e, user.id=92deee10b3eb491899613162290b0a5b) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:28.729875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce2db-4ef4-4cdc-ad47-c4f1b734e390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:28.731570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ce2db-4ef4-4cdc-ad47-c4f1b734e390 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:28.738010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 46/97] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:28 2022] GET /identity/v3/role_assignments?user.id=92deee10b3eb491899613162290b0a5b&scope.project.id=43dd1ab24cb34a14ae46f0007b67608e&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:30.127994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89634d-211f-4f2f-9d88-8946f36af14d None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:30.128501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89634d-211f-4f2f-9d88-8946f36af14d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:30.128573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89634d-211f-4f2f-9d88-8946f36af14d None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:30.129976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 52/98] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:30.137674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918b07-cb9c-4d71-874a-c88a2af2b1da None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:30.137674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918b07-cb9c-4d71-874a-c88a2af2b1da None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:30.137674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918b07-cb9c-4d71-874a-c88a2af2b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:30.153806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-01918b07-cb9c-4d71-874a-c88a2af2b1da None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:30.155386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-01918b07-cb9c-4d71-874a-c88a2af2b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:30.241111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 47/99] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:30.280449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89634d-211f-4f2f-9d88-8946f36af14d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:30.402289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89634d-211f-4f2f-9d88-8946f36af14d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:30.441434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3be770-7744-4731-a689-dcfdfcd873ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:30.442600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3be770-7744-4731-a689-dcfdfcd873ec None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:30.443080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3be770-7744-4731-a689-dcfdfcd873ec None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:30.443574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3be770-7744-4731-a689-dcfdfcd873ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:30.444959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3be770-7744-4731-a689-dcfdfcd873ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:30.446643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3be770-7744-4731-a689-dcfdfcd873ec None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:30.448473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 53/100] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:30.453950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918b07-cb9c-4d71-874a-c88a2af2b1da None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:30.612572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d45e97-635a-4745-97e3-334fc6b584f8 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:30.613525 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d45e97-635a-4745-97e3-334fc6b584f8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:30.614300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d45e97-635a-4745-97e3-334fc6b584f8 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:30.616098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 54/101] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:30.624273 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918b07-cb9c-4d71-874a-c88a2af2b1da None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:30.624831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221fff9-0891-4366-b44c-ae4e033cca2f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:30.625532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221fff9-0891-4366-b44c-ae4e033cca2f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:30.626425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221fff9-0891-4366-b44c-ae4e033cca2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:30.652959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c221fff9-0891-4366-b44c-ae4e033cca2f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:30.654535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c221fff9-0891-4366-b44c-ae4e033cca2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:30.707968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502e1d-f6ff-47a0-a773-d55adfb5d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:30.709284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502e1d-f6ff-47a0-a773-d55adfb5d5a2 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:30.709795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502e1d-f6ff-47a0-a773-d55adfb5d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:30.710287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502e1d-f6ff-47a0-a773-d55adfb5d5a2 None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:30.711203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502e1d-f6ff-47a0-a773-d55adfb5d5a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:30.712846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502e1d-f6ff-47a0-a773-d55adfb5d5a2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:30.752227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 48/102] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:24:30 2022] POST /identity/v3/projects => generated 302 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:30.754592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1c2b-e233-4cbb-a1fc-597cdb4643b1 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:30.756441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 55/103] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:30.757142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1c2b-e233-4cbb-a1fc-597cdb4643b1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:30.757672 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1c2b-e233-4cbb-a1fc-597cdb4643b1 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:30.759415 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 49/104] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:30.765562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edfa56-9960-49ee-ae82-119491ff5ed1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:30.766216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edfa56-9960-49ee-ae82-119491ff5ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:30.766727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edfa56-9960-49ee-ae82-119491ff5ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:30.791430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-66edfa56-9960-49ee-ae82-119491ff5ed1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:30.793055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-66edfa56-9960-49ee-ae82-119491ff5ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:30.843149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c1c2b-e233-4cbb-a1fc-597cdb4643b1 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:30.912126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 56/105] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:30.954837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edfa56-9960-49ee-ae82-119491ff5ed1 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.036902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c1c2b-e233-4cbb-a1fc-597cdb4643b1 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.090594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f5da-917f-457d-b1f4-00429458e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.091397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f5da-917f-457d-b1f4-00429458e895 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.091679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f5da-917f-457d-b1f4-00429458e895 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.091957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f5da-917f-457d-b1f4-00429458e895 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.106378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f5da-917f-457d-b1f4-00429458e895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:31.109218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edfa56-9960-49ee-ae82-119491ff5ed1 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-16c6f5da-917f-457d-b1f4-00429458e895 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:31.115860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:31.116749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:31.117481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 50/106] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:31.119607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382fbb-c739-41a2-8d18-02a1bf4d6f69 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.119607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382fbb-c739-41a2-8d18-02a1bf4d6f69 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.119607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b382fbb-c739-41a2-8d18-02a1bf4d6f69 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.120584 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 51/107] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:31.129565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b382fbb-c739-41a2-8d18-02a1bf4d6f69 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.149806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71919eb-00a3-425c-8e9d-2cebf9a7eb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.150617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71919eb-00a3-425c-8e9d-2cebf9a7eb97 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.151061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71919eb-00a3-425c-8e9d-2cebf9a7eb97 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.151484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71919eb-00a3-425c-8e9d-2cebf9a7eb97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.163174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71919eb-00a3-425c-8e9d-2cebf9a7eb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-a71919eb-00a3-425c-8e9d-2cebf9a7eb97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:31.171563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:31.172392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:31.173132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:31.175898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 57/108] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:31.177313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a397f-6bde-4e1a-8770-14a1a07ca29e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.177887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a397f-6bde-4e1a-8770-14a1a07ca29e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.178334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a397f-6bde-4e1a-8770-14a1a07ca29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.195581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-5e4a397f-6bde-4e1a-8770-14a1a07ca29e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:31.197026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5e4a397f-6bde-4e1a-8770-14a1a07ca29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:31.255616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b382fbb-c739-41a2-8d18-02a1bf4d6f69 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.270910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 58/109] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:31.272364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a397f-6bde-4e1a-8770-14a1a07ca29e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.307095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.308004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.308432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.308874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.309805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:31.310270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:31.312041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:31.322447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 52/110] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:31.323555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.371022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a397f-6bde-4e1a-8770-14a1a07ca29e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.404984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.405918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.406385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.406859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.407769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:31.408250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:31.409873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:31.418663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 59/111] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:31.419696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.428097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f951fca-778f-435e-aed7-727c4476357f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.471613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca7170-6da7-4086-b8eb-a48c54acf2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.472453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca7170-6da7-4086-b8eb-a48c54acf2dc None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.472736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca7170-6da7-4086-b8eb-a48c54acf2dc None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.473008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca7170-6da7-4086-b8eb-a48c54acf2dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.491323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca7170-6da7-4086-b8eb-a48c54acf2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-64ca7170-6da7-4086-b8eb-a48c54acf2dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:31.506124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:31.507017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:31.507737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:31.508402 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 53/112] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:31.510063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca7170-6da7-4086-b8eb-a48c54acf2dc None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.606020 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51c58-ddc6-4b42-82c5-6c2b04049c0d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.678843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3f82-fc9d-4895-8e8d-1e84c92aab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.680002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3f82-fc9d-4895-8e8d-1e84c92aab79 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.680442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3f82-fc9d-4895-8e8d-1e84c92aab79 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.680854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d3f82-fc9d-4895-8e8d-1e84c92aab79 None admin] PATH_INFO: `/v3/users/cec815dd9295451f98af7023fd9d98cc` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.709103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3f82-fc9d-4895-8e8d-1e84c92aab79 None admin] RBAC: Authorizing `identity:get_user(user_id=cec815dd9295451f98af7023fd9d98cc)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:31.710815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d3f82-fc9d-4895-8e8d-1e84c92aab79 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:31.713048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 60/113] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:31 2022] GET /identity/v3/users/cec815dd9295451f98af7023fd9d98cc => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:31.714074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3f82-fc9d-4895-8e8d-1e84c92aab79 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.725330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca7170-6da7-4086-b8eb-a48c54acf2dc None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.781147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324110c-879c-41e0-817f-4f789064931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.782374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324110c-879c-41e0-817f-4f789064931b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.782668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324110c-879c-41e0-817f-4f789064931b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.782950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324110c-879c-41e0-817f-4f789064931b None admin] PATH_INFO: `/v3/users/2752110942d445b6bd51fbda49f0d6b8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.784964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324110c-879c-41e0-817f-4f789064931b None admin] RBAC: Authorizing `identity:get_user(user_id=2752110942d445b6bd51fbda49f0d6b8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:31.786466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324110c-879c-41e0-817f-4f789064931b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:31.788968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 54/114] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:31 2022] GET /identity/v3/users/2752110942d445b6bd51fbda49f0d6b8 => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:31.789609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324110c-879c-41e0-817f-4f789064931b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.822775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d3f82-fc9d-4895-8e8d-1e84c92aab79 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.855672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5abc49-d3fb-45f1-b201-4a679147a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.856319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5abc49-d3fb-45f1-b201-4a679147a4dd None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.856605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5abc49-d3fb-45f1-b201-4a679147a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.856880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5abc49-d3fb-45f1-b201-4a679147a4dd None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.857661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5abc49-d3fb-45f1-b201-4a679147a4dd None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:31.857973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5abc49-d3fb-45f1-b201-4a679147a4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:31.859370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5abc49-d3fb-45f1-b201-4a679147a4dd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:31.868306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 61/115] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:31.869641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2edbb-3b70-47c9-b37e-56b46b614179 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.869910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2edbb-3b70-47c9-b37e-56b46b614179 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.870192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2edbb-3b70-47c9-b37e-56b46b614179 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.871439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 62/116] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:31.872140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2edbb-3b70-47c9-b37e-56b46b614179 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:31.921566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324110c-879c-41e0-817f-4f789064931b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:31.955611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7666690-c516-4a57-9563-a264cef8c46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:31.956727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666690-c516-4a57-9563-a264cef8c46b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:31.957019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666690-c516-4a57-9563-a264cef8c46b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:31.957296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666690-c516-4a57-9563-a264cef8c46b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:31.977636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2edbb-3b70-47c9-b37e-56b46b614179 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.012925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d1eea-bdd5-4599-80c0-090a69cb3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.013860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1eea-bdd5-4599-80c0-090a69cb3298 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.014147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1eea-bdd5-4599-80c0-090a69cb3298 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.014425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1eea-bdd5-4599-80c0-090a69cb3298 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.015711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d1eea-bdd5-4599-80c0-090a69cb3298 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.017225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d1eea-bdd5-4599-80c0-090a69cb3298 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.019597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 63/117] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:31 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:32.020898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ec4f-90d6-41b6-9bb1-66334e0b363f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.021196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ec4f-90d6-41b6-9bb1-66334e0b363f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.021477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60ec4f-90d6-41b6-9bb1-66334e0b363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.032563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7666690-c516-4a57-9563-a264cef8c46b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.034278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7666690-c516-4a57-9563-a264cef8c46b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.038560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-aa60ec4f-90d6-41b6-9bb1-66334e0b363f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:32.039748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-aa60ec4f-90d6-41b6-9bb1-66334e0b363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:32.105360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 64/118] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:32.106276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60ec4f-90d6-41b6-9bb1-66334e0b363f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.136139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 55/119] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:32.136836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7666690-c516-4a57-9563-a264cef8c46b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.205557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60ec4f-90d6-41b6-9bb1-66334e0b363f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.237843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7666690-c516-4a57-9563-a264cef8c46b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.239810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b245996-3d54-4fb9-8ab5-f8bd7a96c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.240685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b245996-3d54-4fb9-8ab5-f8bd7a96c58a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.240966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b245996-3d54-4fb9-8ab5-f8bd7a96c58a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.241243 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b245996-3d54-4fb9-8ab5-f8bd7a96c58a None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.242472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b245996-3d54-4fb9-8ab5-f8bd7a96c58a None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.243953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b245996-3d54-4fb9-8ab5-f8bd7a96c58a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.245599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 65/120] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:32.249811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b245996-3d54-4fb9-8ab5-f8bd7a96c58a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.276902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c9353-434c-4550-98c5-54faaca664f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.278051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c9353-434c-4550-98c5-54faaca664f9 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.278349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c9353-434c-4550-98c5-54faaca664f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.278629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c9353-434c-4550-98c5-54faaca664f9 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3/users/2752110942d445b6bd51fbda49f0d6b8/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.280997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c9353-434c-4550-98c5-54faaca664f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ce4f52f95b46479b0949667e03c0d3, user_id=2752110942d445b6bd51fbda49f0d6b8, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.282747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c9353-434c-4550-98c5-54faaca664f9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.300706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 56/121] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:32 2022] PUT /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3/users/2752110942d445b6bd51fbda49f0d6b8/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:32.302445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c9353-434c-4550-98c5-54faaca664f9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.361458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b245996-3d54-4fb9-8ab5-f8bd7a96c58a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.398223 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f133-1622-4122-ae0f-ac79f58939f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.399168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f133-1622-4122-ae0f-ac79f58939f4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.399526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f133-1622-4122-ae0f-ac79f58939f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.399874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f133-1622-4122-ae0f-ac79f58939f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.412347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f133-1622-4122-ae0f-ac79f58939f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-1325f133-1622-4122-ae0f-ac79f58939f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:32.420893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:32.422150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:32.422904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 66/122] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:32.424537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73ead-7dae-4be3-8559-36d2a881c889 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.425461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73ead-7dae-4be3-8559-36d2a881c889 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.425899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73ead-7dae-4be3-8559-36d2a881c889 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.427423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 67/123] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:32.428057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73ead-7dae-4be3-8559-36d2a881c889 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.440507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c9353-434c-4550-98c5-54faaca664f9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.478778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c30649-2661-4fc4-a058-df9927ae3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.479983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30649-2661-4fc4-a058-df9927ae3764 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.480566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30649-2661-4fc4-a058-df9927ae3764 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.481067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30649-2661-4fc4-a058-df9927ae3764 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.482682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c30649-2661-4fc4-a058-df9927ae3764 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.485121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c30649-2661-4fc4-a058-df9927ae3764 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.488127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 57/124] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:32.489751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2cd5d-ece8-4eb3-8bb3-ad3102957da8 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.490252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2cd5d-ece8-4eb3-8bb3-ad3102957da8 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.490745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2cd5d-ece8-4eb3-8bb3-ad3102957da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.510671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-bac2cd5d-ece8-4eb3-8bb3-ad3102957da8 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:32.512185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-bac2cd5d-ece8-4eb3-8bb3-ad3102957da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:32.553293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73ead-7dae-4be3-8559-36d2a881c889 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.587109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27502bb3-b2be-4155-a3e3-991fe6b27b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.587986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502bb3-b2be-4155-a3e3-991fe6b27b08 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.588330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502bb3-b2be-4155-a3e3-991fe6b27b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.588612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27502bb3-b2be-4155-a3e3-991fe6b27b08 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.589904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27502bb3-b2be-4155-a3e3-991fe6b27b08 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.591402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27502bb3-b2be-4155-a3e3-991fe6b27b08 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.591654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 58/125] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:32.593147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 68/126] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:32.594007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27502bb3-b2be-4155-a3e3-991fe6b27b08 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.597225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2cd5d-ece8-4eb3-8bb3-ad3102957da8 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.703016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2cd5d-ece8-4eb3-8bb3-ad3102957da8 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.717585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27502bb3-b2be-4155-a3e3-991fe6b27b08 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.736981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.737723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.738006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.738334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.739034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:32.739341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.740721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.750225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 59/127] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:32.752402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.753116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.753405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.753716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.754560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] RBAC: Adding query filter params (role.id=5637904dab8642e795bb9ced27c7aae8, scope.project.id=52ce4f52f95b46479b0949667e03c0d3, user.id=cec815dd9295451f98af7023fd9d98cc) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:32.754881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.755453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.756451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.762284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 69/128] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/role_assignments?user.id=cec815dd9295451f98af7023fd9d98cc&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=5637904dab8642e795bb9ced27c7aae8 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:32.763217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.860223 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264be8-6994-489b-beda-f3a966b77ddd None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.870462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789faaf-6d39-432e-8dda-609fb1cad58e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:32.896411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfe16f-3689-464f-8ebe-70fb6f887e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.897364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfe16f-3689-464f-8ebe-70fb6f887e70 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.897688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfe16f-3689-464f-8ebe-70fb6f887e70 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.897970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfe16f-3689-464f-8ebe-70fb6f887e70 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3/users/92deee10b3eb491899613162290b0a5b/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.900132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfe16f-3689-464f-8ebe-70fb6f887e70 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ce4f52f95b46479b0949667e03c0d3, user_id=92deee10b3eb491899613162290b0a5b, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:32.901600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfe16f-3689-464f-8ebe-70fb6f887e70 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:32.910960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee63242-2094-448c-b531-43eea39f8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:32.911920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee63242-2094-448c-b531-43eea39f8d96 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:32.912256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee63242-2094-448c-b531-43eea39f8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:32.912630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee63242-2094-448c-b531-43eea39f8d96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:32.917378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 60/129] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:32 2022] PUT /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3/users/92deee10b3eb491899613162290b0a5b/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:32.922517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfe16f-3689-464f-8ebe-70fb6f887e70 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:32.933279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee63242-2094-448c-b531-43eea39f8d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-eee63242-2094-448c-b531-43eea39f8d96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:32.948917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:32.949911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:32.950655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 70/130] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:32.957522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee63242-2094-448c-b531-43eea39f8d96 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:33.070884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee63242-2094-448c-b531-43eea39f8d96 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:33.107515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:33.108209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.108505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.108844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.109667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:33.109986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:33.111487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:33.115095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfe16f-3689-464f-8ebe-70fb6f887e70 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:33.121049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 71/131] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:33.126792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:33.151491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc440f-6d13-42ab-8d96-99f0e016aae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:33.152376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc440f-6d13-42ab-8d96-99f0e016aae4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.152656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc440f-6d13-42ab-8d96-99f0e016aae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.152928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc440f-6d13-42ab-8d96-99f0e016aae4 None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.154161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc440f-6d13-42ab-8d96-99f0e016aae4 None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:33.155651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc440f-6d13-42ab-8d96-99f0e016aae4 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:33.157333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 61/132] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:32 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:33.163084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc440f-6d13-42ab-8d96-99f0e016aae4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:33.234126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5a12c-447d-454f-83e5-c9600f0a4135 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:33.267826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc440f-6d13-42ab-8d96-99f0e016aae4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:33.270315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867cd7-71e0-43ff-979d-94e87847f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:33.271314 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867cd7-71e0-43ff-979d-94e87847f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.271608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867cd7-71e0-43ff-979d-94e87847f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.271938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867cd7-71e0-43ff-979d-94e87847f5d0 None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.273176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867cd7-71e0-43ff-979d-94e87847f5d0 None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:33.274673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867cd7-71e0-43ff-979d-94e87847f5d0 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:33.276330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 72/133] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:33 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:33.282278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867cd7-71e0-43ff-979d-94e87847f5d0 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:33.303973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcc61-2bea-46f9-b577-bf47a9847110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:33.304851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcc61-2bea-46f9-b577-bf47a9847110 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.305131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcc61-2bea-46f9-b577-bf47a9847110 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.305403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bcc61-2bea-46f9-b577-bf47a9847110 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.306647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bcc61-2bea-46f9-b577-bf47a9847110 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:33.308277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bcc61-2bea-46f9-b577-bf47a9847110 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:33.313651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 62/134] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:33 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:33.317081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcc61-2bea-46f9-b577-bf47a9847110 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:33.389153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867cd7-71e0-43ff-979d-94e87847f5d0 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:33.418803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bcc61-2bea-46f9-b577-bf47a9847110 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:33.423715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e20091-194d-411d-b70a-851dd2f4e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:33.424642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e20091-194d-411d-b70a-851dd2f4e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.424980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e20091-194d-411d-b70a-851dd2f4e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.425261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e20091-194d-411d-b70a-851dd2f4e7d8 None admin] PATH_INFO: `/v3/projects/43dd1ab24cb34a14ae46f0007b67608e` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.426503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e20091-194d-411d-b70a-851dd2f4e7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=43dd1ab24cb34a14ae46f0007b67608e)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:33.427979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e20091-194d-411d-b70a-851dd2f4e7d8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:33.429777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 73/135] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:33 2022] GET /identity/v3/projects/43dd1ab24cb34a14ae46f0007b67608e => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:33.435544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e20091-194d-411d-b70a-851dd2f4e7d8 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:33.467364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda15ba-77b8-4aa1-8fd3-8b1405800702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:33.468272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda15ba-77b8-4aa1-8fd3-8b1405800702 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.468551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda15ba-77b8-4aa1-8fd3-8b1405800702 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.468823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda15ba-77b8-4aa1-8fd3-8b1405800702 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3/users/92deee10b3eb491899613162290b0a5b/roles/aa78a08951eb49f78aeda141988844de` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.474677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda15ba-77b8-4aa1-8fd3-8b1405800702 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ce4f52f95b46479b0949667e03c0d3, user_id=92deee10b3eb491899613162290b0a5b, role_id=aa78a08951eb49f78aeda141988844de)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:33.476154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda15ba-77b8-4aa1-8fd3-8b1405800702 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:33.509635 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 63/136] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:33 2022] PUT /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3/users/92deee10b3eb491899613162290b0a5b/roles/aa78a08951eb49f78aeda141988844de => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:24:33.585928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e20091-194d-411d-b70a-851dd2f4e7d8 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:33.625683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ca436-ed24-4208-9b06-89d06763a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:33.626825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ca436-ed24-4208-9b06-89d06763a78e None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.627245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ca436-ed24-4208-9b06-89d06763a78e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.627653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ca436-ed24-4208-9b06-89d06763a78e None admin] PATH_INFO: `/v3/projects/43dd1ab24cb34a14ae46f0007b67608e/users/92deee10b3eb491899613162290b0a5b/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.630478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ca436-ed24-4208-9b06-89d06763a78e None admin] RBAC: Authorizing `identity:create_grant(project_id=43dd1ab24cb34a14ae46f0007b67608e, user_id=92deee10b3eb491899613162290b0a5b, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:33.632174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ca436-ed24-4208-9b06-89d06763a78e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:33.647633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 74/137] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:33 2022] PUT /identity/v3/projects/43dd1ab24cb34a14ae46f0007b67608e/users/92deee10b3eb491899613162290b0a5b/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:33.817862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e028-0701-4a92-b8af-a0bdce85872a None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.818188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e028-0701-4a92-b8af-a0bdce85872a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.818438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e028-0701-4a92-b8af-a0bdce85872a None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.819840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 64/138] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:33.825820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084c1e-9fa4-48cb-9832-6248ba799656 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:33.826450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084c1e-9fa4-48cb-9832-6248ba799656 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:33.826922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084c1e-9fa4-48cb-9832-6248ba799656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:33.854849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ae084c1e-9fa4-48cb-9832-6248ba799656 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:33.856438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ae084c1e-9fa4-48cb-9832-6248ba799656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:33.950070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 75/139] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:33.979505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5e028-0701-4a92-b8af-a0bdce85872a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:34.101816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5e028-0701-4a92-b8af-a0bdce85872a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:34.141930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f491ac-3f34-4f7e-90aa-5f50b1847268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:34.145442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f491ac-3f34-4f7e-90aa-5f50b1847268 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:34.145936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f491ac-3f34-4f7e-90aa-5f50b1847268 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:34.146399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f491ac-3f34-4f7e-90aa-5f50b1847268 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:34.147771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f491ac-3f34-4f7e-90aa-5f50b1847268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:34.149419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f491ac-3f34-4f7e-90aa-5f50b1847268 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:34.151590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 65/140] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:34.157297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084c1e-9fa4-48cb-9832-6248ba799656 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:34.271183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084c1e-9fa4-48cb-9832-6248ba799656 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:34.310364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed387dfc-2e70-4feb-aa1e-0df3d4868db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:34.311369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed387dfc-2e70-4feb-aa1e-0df3d4868db1 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:34.312090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed387dfc-2e70-4feb-aa1e-0df3d4868db1 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:34.312547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed387dfc-2e70-4feb-aa1e-0df3d4868db1 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:34.313450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed387dfc-2e70-4feb-aa1e-0df3d4868db1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:34.315122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed387dfc-2e70-4feb-aa1e-0df3d4868db1 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:34.355015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 76/141] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:24:34 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:35.180610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b68d-de14-4e98-aa12-2f1c307b2fc6 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:35.181663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b68d-de14-4e98-aa12-2f1c307b2fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:35.182164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9b68d-de14-4e98-aa12-2f1c307b2fc6 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:35.183753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 66/142] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:35.189290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8329f-0d44-4435-899b-d342cab73b64 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:35.189830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8329f-0d44-4435-899b-d342cab73b64 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:35.190928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8329f-0d44-4435-899b-d342cab73b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:35.207798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-91a8329f-0d44-4435-899b-d342cab73b64 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:35.209281 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-91a8329f-0d44-4435-899b-d342cab73b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:35.302374 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 77/143] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:35.344078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9b68d-de14-4e98-aa12-2f1c307b2fc6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:35.482355 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9b68d-de14-4e98-aa12-2f1c307b2fc6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:35.524972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a455a1-cc7a-44e6-9aad-f4011715dbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:35.525879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a455a1-cc7a-44e6-9aad-f4011715dbec None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:35.526163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a455a1-cc7a-44e6-9aad-f4011715dbec None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:35.526437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a455a1-cc7a-44e6-9aad-f4011715dbec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:35.547054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a455a1-cc7a-44e6-9aad-f4011715dbec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-53a455a1-cc7a-44e6-9aad-f4011715dbec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:35.555406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:35.556283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:35.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 67/144] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:35.563805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8329f-0d44-4435-899b-d342cab73b64 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:35.713150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8329f-0d44-4435-899b-d342cab73b64 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:35.747679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:35.748277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:35.748566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:35.748849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:35.749626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:35.749944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:35.751343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:35.765081 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 78/145] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:35.770757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a455a1-cc7a-44e6-9aad-f4011715dbec None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:35.919054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a455a1-cc7a-44e6-9aad-f4011715dbec None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:35.971652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8adab-f42d-429b-9f5a-1de13e94fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:35.972788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8adab-f42d-429b-9f5a-1de13e94fea3 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:35.973217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8adab-f42d-429b-9f5a-1de13e94fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:35.973649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8adab-f42d-429b-9f5a-1de13e94fea3 None admin] PATH_INFO: `/v3/users/2752110942d445b6bd51fbda49f0d6b8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:35.978251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8adab-f42d-429b-9f5a-1de13e94fea3 None admin] RBAC: Authorizing `identity:get_user(user_id=2752110942d445b6bd51fbda49f0d6b8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:35.979881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8adab-f42d-429b-9f5a-1de13e94fea3 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:35.981691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 68/146] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:35 2022] GET /identity/v3/users/2752110942d445b6bd51fbda49f0d6b8 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:35.987933 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:36.109209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9e395-72da-4a72-a349-ba761b3e7ff3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:36.146251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccb800-e919-4975-b99e-3505055fa4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:36.146911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccb800-e919-4975-b99e-3505055fa4c7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:36.147201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccb800-e919-4975-b99e-3505055fa4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:36.147482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccb800-e919-4975-b99e-3505055fa4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:36.228300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccb800-e919-4975-b99e-3505055fa4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:36.229841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccb800-e919-4975-b99e-3505055fa4c7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:36.333131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 79/147] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:36.339085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8adab-f42d-429b-9f5a-1de13e94fea3 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:36.476663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8adab-f42d-429b-9f5a-1de13e94fea3 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:36.521798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ff96c-d202-4119-b200-0a9d2d65638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:36.522693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ff96c-d202-4119-b200-0a9d2d65638b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:36.522978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ff96c-d202-4119-b200-0a9d2d65638b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:36.523256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ff96c-d202-4119-b200-0a9d2d65638b None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:36.524510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ff96c-d202-4119-b200-0a9d2d65638b None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:36.526008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ff96c-d202-4119-b200-0a9d2d65638b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:36.527736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 69/148] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:36 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:36.533727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccb800-e919-4975-b99e-3505055fa4c7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:36.550656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bafc37-3d2f-480e-86be-929e46c0532d None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:36.550656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bafc37-3d2f-480e-86be-929e46c0532d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:36.550656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bafc37-3d2f-480e-86be-929e46c0532d None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:36.552225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 70/149] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:36.557196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6da6-b617-49d3-acaa-9d6f5ee92f43 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:36.557482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6da6-b617-49d3-acaa-9d6f5ee92f43 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:36.557816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd6da6-b617-49d3-acaa-9d6f5ee92f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:36.578482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-dafd6da6-b617-49d3-acaa-9d6f5ee92f43 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:36.579665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-dafd6da6-b617-49d3-acaa-9d6f5ee92f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:36.667108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 71/150] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:36.720835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd6da6-b617-49d3-acaa-9d6f5ee92f43 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:36.734086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccb800-e919-4975-b99e-3505055fa4c7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:36.795660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ecea3-e6c5-4a63-a269-66c0edb7b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:36.796704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ecea3-e6c5-4a63-a269-66c0edb7b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:36.797196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ecea3-e6c5-4a63-a269-66c0edb7b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:36.797729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ecea3-e6c5-4a63-a269-66c0edb7b2d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:36.798775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ecea3-e6c5-4a63-a269-66c0edb7b2d3 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=52ce4f52f95b46479b0949667e03c0d3, user.id=2752110942d445b6bd51fbda49f0d6b8) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:36.799299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ecea3-e6c5-4a63-a269-66c0edb7b2d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:36.801026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ecea3-e6c5-4a63-a269-66c0edb7b2d3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:36.816641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 80/151] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:36 2022] GET /identity/v3/role_assignments?user.id=2752110942d445b6bd51fbda49f0d6b8&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=de114c58fdc8476ebab657e6f9359155 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:36.838464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d83e9-779e-4e19-a6c5-1f225745cfa8 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:36.839107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d83e9-779e-4e19-a6c5-1f225745cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:36.839590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d83e9-779e-4e19-a6c5-1f225745cfa8 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:36.841424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 81/152] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:36.847269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec56af-e3e3-47e1-b1cf-b7b999744506 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:36.847885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec56af-e3e3-47e1-b1cf-b7b999744506 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:36.848361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec56af-e3e3-47e1-b1cf-b7b999744506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:36.859499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd6da6-b617-49d3-acaa-9d6f5ee92f43 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:36.879180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-deec56af-e3e3-47e1-b1cf-b7b999744506 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:36.882844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-deec56af-e3e3-47e1-b1cf-b7b999744506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:36.916683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b55a71-31d5-4767-ab89-667862ab5ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:36.917866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b55a71-31d5-4767-ab89-667862ab5ebc None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:36.918353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b55a71-31d5-4767-ab89-667862ab5ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:36.918864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b55a71-31d5-4767-ab89-667862ab5ebc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:36.950618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b55a71-31d5-4767-ab89-667862ab5ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-c4b55a71-31d5-4767-ab89-667862ab5ebc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:36.959738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:36.960660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:36.961398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:36.968151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 72/153] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:36.974075 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b55a71-31d5-4767-ab89-667862ab5ebc None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.005258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 82/154] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:37.050515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec56af-e3e3-47e1-b1cf-b7b999744506 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.168032 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b55a71-31d5-4767-ab89-667862ab5ebc None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:37.208104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9df397-f25c-4f51-bfba-9338450f5924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:37.209042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df397-f25c-4f51-bfba-9338450f5924 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.209488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df397-f25c-4f51-bfba-9338450f5924 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.209946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df397-f25c-4f51-bfba-9338450f5924 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.210310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec56af-e3e3-47e1-b1cf-b7b999744506 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:37.210850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df397-f25c-4f51-bfba-9338450f5924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:37.211302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df397-f25c-4f51-bfba-9338450f5924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:37.212854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9df397-f25c-4f51-bfba-9338450f5924 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:37.222006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 73/155] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:37.223615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab0375-8855-4712-a90a-4af928caaa27 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.224120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab0375-8855-4712-a90a-4af928caaa27 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.224606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab0375-8855-4712-a90a-4af928caaa27 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.226123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 74/156] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:37.232135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab0375-8855-4712-a90a-4af928caaa27 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.281941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4508c7-b4dc-4dfb-822c-e70fb61fad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:37.283602 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4508c7-b4dc-4dfb-822c-e70fb61fad7c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.285389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4508c7-b4dc-4dfb-822c-e70fb61fad7c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.287309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4508c7-b4dc-4dfb-822c-e70fb61fad7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.316631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4508c7-b4dc-4dfb-822c-e70fb61fad7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-fa4508c7-b4dc-4dfb-822c-e70fb61fad7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:37.329563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:37.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:37.331242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:37.333769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 83/157] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:37.335739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977c2b-20c1-4993-b112-8bf7275e1c1e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.336197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977c2b-20c1-4993-b112-8bf7275e1c1e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.336649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16977c2b-20c1-4993-b112-8bf7275e1c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.366543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-16977c2b-20c1-4993-b112-8bf7275e1c1e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:37.368023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-16977c2b-20c1-4993-b112-8bf7275e1c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:37.378734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab0375-8855-4712-a90a-4af928caaa27 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:37.418578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0502e-05e0-4fba-8430-06095065050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:37.423667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0502e-05e0-4fba-8430-06095065050b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.424264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0502e-05e0-4fba-8430-06095065050b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.425236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0502e-05e0-4fba-8430-06095065050b None admin] PATH_INFO: `/v3/users/cec815dd9295451f98af7023fd9d98cc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.427105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0502e-05e0-4fba-8430-06095065050b None admin] RBAC: Authorizing `identity:get_user(user_id=cec815dd9295451f98af7023fd9d98cc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:37.428713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0502e-05e0-4fba-8430-06095065050b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:37.431100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 75/158] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:37 2022] GET /identity/v3/users/cec815dd9295451f98af7023fd9d98cc => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:37.432247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0502e-05e0-4fba-8430-06095065050b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.511684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 84/159] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:37.512981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16977c2b-20c1-4993-b112-8bf7275e1c1e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.553085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0502e-05e0-4fba-8430-06095065050b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:37.592626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:37.593618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.594062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.594512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.595401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:37.595845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:37.597976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:37.606548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 76/160] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:37.608382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.660950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16977c2b-20c1-4993-b112-8bf7275e1c1e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:37.716227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3fde-ad2d-455e-bc95-e8e3d5fac169 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:37.719154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88144f98-72ff-429c-9844-91a85c59469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:37.720229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88144f98-72ff-429c-9844-91a85c59469d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.720655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88144f98-72ff-429c-9844-91a85c59469d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.721061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88144f98-72ff-429c-9844-91a85c59469d None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.725967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88144f98-72ff-429c-9844-91a85c59469d None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:37.727591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88144f98-72ff-429c-9844-91a85c59469d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:37.729504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 85/161] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:37 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:37.730472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88144f98-72ff-429c-9844-91a85c59469d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.752369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17f18-e607-4a67-8809-87886bd02fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:37.753485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17f18-e607-4a67-8809-87886bd02fd3 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.753972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17f18-e607-4a67-8809-87886bd02fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.754487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17f18-e607-4a67-8809-87886bd02fd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.765195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17f18-e607-4a67-8809-87886bd02fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-24a17f18-e607-4a67-8809-87886bd02fd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:37.773283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:37.774520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:37.775525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:37.777395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 77/162] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:37.778359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17f18-e607-4a67-8809-87886bd02fd3 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.875782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88144f98-72ff-429c-9844-91a85c59469d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:37.883413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17f18-e607-4a67-8809-87886bd02fd3 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:37.920317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe23c1-50d3-4a99-a37d-2f7f4da1dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:37.921453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe23c1-50d3-4a99-a37d-2f7f4da1dfe9 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.922000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe23c1-50d3-4a99-a37d-2f7f4da1dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.922412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe23c1-50d3-4a99-a37d-2f7f4da1dfe9 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3/users/cec815dd9295451f98af7023fd9d98cc/roles/5637904dab8642e795bb9ced27c7aae8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.924565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe23c1-50d3-4a99-a37d-2f7f4da1dfe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ce4f52f95b46479b0949667e03c0d3, user_id=cec815dd9295451f98af7023fd9d98cc, role_id=5637904dab8642e795bb9ced27c7aae8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:37.926882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe23c1-50d3-4a99-a37d-2f7f4da1dfe9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:37.935307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbff7-20fa-48c5-9ea0-dc41c7d239ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:37.937923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbff7-20fa-48c5-9ea0-dc41c7d239ab None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:37.938676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbff7-20fa-48c5-9ea0-dc41c7d239ab None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:37.939896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbff7-20fa-48c5-9ea0-dc41c7d239ab None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:37.943059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdbff7-20fa-48c5-9ea0-dc41c7d239ab None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:37.946783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdbff7-20fa-48c5-9ea0-dc41c7d239ab None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:37.950247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 78/163] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:37 2022] PUT /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3/users/cec815dd9295451f98af7023fd9d98cc/roles/5637904dab8642e795bb9ced27c7aae8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:37.952114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 86/164] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:37 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:37.952297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe23c1-50d3-4a99-a37d-2f7f4da1dfe9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:37.958678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbff7-20fa-48c5-9ea0-dc41c7d239ab None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:38.140539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbff7-20fa-48c5-9ea0-dc41c7d239ab None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:38.181458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe23c1-50d3-4a99-a37d-2f7f4da1dfe9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:38.199404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a370d31-e618-44d7-a0d6-1ed57d061352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:38.200297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370d31-e618-44d7-a0d6-1ed57d061352 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.200405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370d31-e618-44d7-a0d6-1ed57d061352 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.200610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370d31-e618-44d7-a0d6-1ed57d061352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.278608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3a420-9a57-4d6e-b55d-023112e320a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:38.279296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3a420-9a57-4d6e-b55d-023112e320a8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.279583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3a420-9a57-4d6e-b55d-023112e320a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.279862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3a420-9a57-4d6e-b55d-023112e320a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.280686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3a420-9a57-4d6e-b55d-023112e320a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:38.280924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3a420-9a57-4d6e-b55d-023112e320a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:38.282354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3a420-9a57-4d6e-b55d-023112e320a8 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:38.292840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a370d31-e618-44d7-a0d6-1ed57d061352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:38.294193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 79/165] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:38.294922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a370d31-e618-44d7-a0d6-1ed57d061352 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:38.302022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ebb1-db3a-4818-9198-6dac20b08336 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.302400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ebb1-db3a-4818-9198-6dac20b08336 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.302578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ebb1-db3a-4818-9198-6dac20b08336 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.304241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 80/166] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:38.304813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ebb1-db3a-4818-9198-6dac20b08336 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:38.419219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ebb1-db3a-4818-9198-6dac20b08336 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:38.428376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 87/167] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:38.431658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e127a3-58a2-4c62-97a0-82a676df13c6 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.432237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e127a3-58a2-4c62-97a0-82a676df13c6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.432992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e127a3-58a2-4c62-97a0-82a676df13c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.458379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-23e127a3-58a2-4c62-97a0-82a676df13c6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:38.459974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-23e127a3-58a2-4c62-97a0-82a676df13c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:38.461901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03bca-fe49-4d22-9442-77b0f77c3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:38.462799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03bca-fe49-4d22-9442-77b0f77c3c34 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.463080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03bca-fe49-4d22-9442-77b0f77c3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.463353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03bca-fe49-4d22-9442-77b0f77c3c34 None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.464895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03bca-fe49-4d22-9442-77b0f77c3c34 None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:38.466068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03bca-fe49-4d22-9442-77b0f77c3c34 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:38.468010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 81/168] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:38 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:38.468795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03bca-fe49-4d22-9442-77b0f77c3c34 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:38.546707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 88/169] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:38.547810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e127a3-58a2-4c62-97a0-82a676df13c6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:38.602152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03bca-fe49-4d22-9442-77b0f77c3c34 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:38.642049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcfa0c-3d58-403c-921c-1c6179ee6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:38.642915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcfa0c-3d58-403c-921c-1c6179ee6e4a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.643201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcfa0c-3d58-403c-921c-1c6179ee6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.643513 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcfa0c-3d58-403c-921c-1c6179ee6e4a None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.645573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcfa0c-3d58-403c-921c-1c6179ee6e4a None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:38.647028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcfa0c-3d58-403c-921c-1c6179ee6e4a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:38.648904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 82/170] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:38 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:38.653802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcfa0c-3d58-403c-921c-1c6179ee6e4a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:38.687938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e127a3-58a2-4c62-97a0-82a676df13c6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:38.722923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5f6c-aeed-4934-804d-1f492e04bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:38.723627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5f6c-aeed-4934-804d-1f492e04bd0e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.723911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5f6c-aeed-4934-804d-1f492e04bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.724250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f5f6c-aeed-4934-804d-1f492e04bd0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.761701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcfa0c-3d58-403c-921c-1c6179ee6e4a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:38.792763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f5f6c-aeed-4934-804d-1f492e04bd0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:38.794284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f5f6c-aeed-4934-804d-1f492e04bd0e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:38.796571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec0254-2d29-4e23-9357-140f868ecdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:38.797610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0254-2d29-4e23-9357-140f868ecdb4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.798087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0254-2d29-4e23-9357-140f868ecdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.798572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec0254-2d29-4e23-9357-140f868ecdb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.809142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec0254-2d29-4e23-9357-140f868ecdb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5cec0254-2d29-4e23-9357-140f868ecdb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:38.817514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:38.818374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:38.819383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:38.822000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 83/171] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:38.826224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec0254-2d29-4e23-9357-140f868ecdb4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:38.894749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 89/172] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:38.895424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5f6c-aeed-4934-804d-1f492e04bd0e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:38.930869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec0254-2d29-4e23-9357-140f868ecdb4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:38.973220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:38.974237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:38.974719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:38.975210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:38.976262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] RBAC: Adding query filter params (role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=52ce4f52f95b46479b0949667e03c0d3, user.id=92deee10b3eb491899613162290b0a5b) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:38.976774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:38.978498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:38.984861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 84/173] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:38 2022] GET /identity/v3/role_assignments?user.id=92deee10b3eb491899613162290b0a5b&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=aa78a08951eb49f78aeda141988844de => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:38.985979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:39.002192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f5f6c-aeed-4934-804d-1f492e04bd0e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:39.038880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:39.039555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:39.039882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:39.040165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:39.040916 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:39.041336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:39.042684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:39.052404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 90/174] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:39.057963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:39.100219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb4e14-ba4b-4a02-bee2-d97751d98f02 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:39.134920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e52e58-b86d-49f0-910f-9df3d4d34d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:39.135925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52e58-b86d-49f0-910f-9df3d4d34d09 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:39.136280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52e58-b86d-49f0-910f-9df3d4d34d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:39.136993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52e58-b86d-49f0-910f-9df3d4d34d09 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:39.137907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e52e58-b86d-49f0-910f-9df3d4d34d09 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:39.139542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e52e58-b86d-49f0-910f-9df3d4d34d09 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:39.141431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 85/175] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:38 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:39.149052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e52e58-b86d-49f0-910f-9df3d4d34d09 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:39.163998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89456c-3b95-42bc-9c94-ed07ed1a31be None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:39.199305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e51d7-650a-4083-b4a8-753e3c479857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:39.200194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e51d7-650a-4083-b4a8-753e3c479857 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:39.200479 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e51d7-650a-4083-b4a8-753e3c479857 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:39.200754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e51d7-650a-4083-b4a8-753e3c479857 None admin] PATH_INFO: `/v3/users/92deee10b3eb491899613162290b0a5b` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:39.202040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e51d7-650a-4083-b4a8-753e3c479857 None admin] RBAC: Authorizing `identity:get_user(user_id=92deee10b3eb491899613162290b0a5b)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:39.203539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e51d7-650a-4083-b4a8-753e3c479857 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:39.209598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 91/176] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:39 2022] GET /identity/v3/users/92deee10b3eb491899613162290b0a5b => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:39.228010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e51d7-650a-4083-b4a8-753e3c479857 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:39.270233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e52e58-b86d-49f0-910f-9df3d4d34d09 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:39.305642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bac82d-15b0-4cae-8f5a-dbd708809f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:39.306684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac82d-15b0-4cae-8f5a-dbd708809f1f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:39.307164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac82d-15b0-4cae-8f5a-dbd708809f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:39.307710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac82d-15b0-4cae-8f5a-dbd708809f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:39.308753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bac82d-15b0-4cae-8f5a-dbd708809f1f None admin] RBAC: Adding query filter params (role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=52ce4f52f95b46479b0949667e03c0d3, user.id=92deee10b3eb491899613162290b0a5b) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:39.309276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bac82d-15b0-4cae-8f5a-dbd708809f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:39.311080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bac82d-15b0-4cae-8f5a-dbd708809f1f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:39.318596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 86/177] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:39 2022] GET /identity/v3/role_assignments?user.id=92deee10b3eb491899613162290b0a5b&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:39.377661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e51d7-650a-4083-b4a8-753e3c479857 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:39.424387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d984cc6-aa40-41c3-9fc1-c632bfdf0afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:39.425460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d984cc6-aa40-41c3-9fc1-c632bfdf0afa None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:39.425976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d984cc6-aa40-41c3-9fc1-c632bfdf0afa None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:39.426507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d984cc6-aa40-41c3-9fc1-c632bfdf0afa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:39.518071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d984cc6-aa40-41c3-9fc1-c632bfdf0afa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:39.519646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d984cc6-aa40-41c3-9fc1-c632bfdf0afa None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:39.552742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62f08-201a-4f05-badf-ae528e0b93fb None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:39.553237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62f08-201a-4f05-badf-ae528e0b93fb None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:39.553308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d62f08-201a-4f05-badf-ae528e0b93fb None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:39.554695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 87/178] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:39.562512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349a1a-15c3-4286-8d2f-3e85c7a411b2 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:39.562793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349a1a-15c3-4286-8d2f-3e85c7a411b2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:39.563074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349a1a-15c3-4286-8d2f-3e85c7a411b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:39.598668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-91349a1a-15c3-4286-8d2f-3e85c7a411b2 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:39.600196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-91349a1a-15c3-4286-8d2f-3e85c7a411b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:39.691372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 92/179] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:24:39.698196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d984cc6-aa40-41c3-9fc1-c632bfdf0afa None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:39.740935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 88/180] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:39.772142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349a1a-15c3-4286-8d2f-3e85c7a411b2 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:39.833474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d984cc6-aa40-41c3-9fc1-c632bfdf0afa None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:39.876124 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9656-efc8-48bf-b523-c69cdc5e96e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:39.877015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9656-efc8-48bf-b523-c69cdc5e96e8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:39.877297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9656-efc8-48bf-b523-c69cdc5e96e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:39.877591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9656-efc8-48bf-b523-c69cdc5e96e8 None admin] PATH_INFO: `/v3/projects/43dd1ab24cb34a14ae46f0007b67608e` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:39.882307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff9656-efc8-48bf-b523-c69cdc5e96e8 None admin] RBAC: Authorizing `identity:get_project(project_id=43dd1ab24cb34a14ae46f0007b67608e)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:39.883802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff9656-efc8-48bf-b523-c69cdc5e96e8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:39.885568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 93/181] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:39 2022] GET /identity/v3/projects/43dd1ab24cb34a14ae46f0007b67608e => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:39.892137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9656-efc8-48bf-b523-c69cdc5e96e8 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:39.995099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349a1a-15c3-4286-8d2f-3e85c7a411b2 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.003605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9656-efc8-48bf-b523-c69cdc5e96e8 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.043354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:40.044041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.044323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.044596 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.045454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] RBAC: Adding query filter params (role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=43dd1ab24cb34a14ae46f0007b67608e, user.id=92deee10b3eb491899613162290b0a5b) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:40.045799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:40.047347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:40.054954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 94/182] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:39 2022] GET /identity/v3/role_assignments?user.id=92deee10b3eb491899613162290b0a5b&scope.project.id=43dd1ab24cb34a14ae46f0007b67608e&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:40.069795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5162667-bdb6-4e98-bf0a-dcdd07e5e945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:40.070621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162667-bdb6-4e98-bf0a-dcdd07e5e945 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.070907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162667-bdb6-4e98-bf0a-dcdd07e5e945 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.071180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5162667-bdb6-4e98-bf0a-dcdd07e5e945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.094818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5162667-bdb6-4e98-bf0a-dcdd07e5e945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-a5162667-bdb6-4e98-bf0a-dcdd07e5e945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:40.103459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:40.104407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:40.105159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 89/183] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:40.110947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:40.164616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5583e2-5ca3-4621-88f9-b26a4bcd58f2 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.164933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5583e2-5ca3-4621-88f9-b26a4bcd58f2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.165170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5583e2-5ca3-4621-88f9-b26a4bcd58f2 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.166950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 90/184] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:40.173253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fb6b3-59fd-42f2-a718-bb24f6b1464a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.173872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fb6b3-59fd-42f2-a718-bb24f6b1464a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.174352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fb6b3-59fd-42f2-a718-bb24f6b1464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.208071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c70fb6b3-59fd-42f2-a718-bb24f6b1464a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:40.210906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c70fb6b3-59fd-42f2-a718-bb24f6b1464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:40.280636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af8b83-9b74-4209-99df-63251be3ec9a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.323862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 91/185] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:40.329929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:40.331385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.331893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.332364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.333306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:40.333849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:40.335432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:40.344459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 95/186] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:40.350786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fb6b3-59fd-42f2-a718-bb24f6b1464a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:40.352961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:40.471456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df47df-c6ed-4af8-8984-2fe84fecb632 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.478567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fb6b3-59fd-42f2-a718-bb24f6b1464a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.510556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412564a4-7717-4b0c-8df5-3105a6946d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:40.511357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412564a4-7717-4b0c-8df5-3105a6946d01 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.511640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412564a4-7717-4b0c-8df5-3105a6946d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.511907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412564a4-7717-4b0c-8df5-3105a6946d01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.513055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412564a4-7717-4b0c-8df5-3105a6946d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:40.514518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412564a4-7717-4b0c-8df5-3105a6946d01 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:40.516301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 96/187] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:40.517271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f166a0-3516-4069-980a-be5c955a45b6 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.517566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f166a0-3516-4069-980a-be5c955a45b6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.517846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f166a0-3516-4069-980a-be5c955a45b6 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.519239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 97/188] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:40.522534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f166a0-3516-4069-980a-be5c955a45b6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:40.523908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53023-02db-4d24-96c3-88becebecaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:40.524787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53023-02db-4d24-96c3-88becebecaea None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.525068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53023-02db-4d24-96c3-88becebecaea None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.525337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53023-02db-4d24-96c3-88becebecaea None admin] PATH_INFO: `/v3/users/faad5fa92fb14f349b794a81663e7527` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.538286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d53023-02db-4d24-96c3-88becebecaea None admin] RBAC: Authorizing `identity:get_user(user_id=faad5fa92fb14f349b794a81663e7527)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:40.539684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d53023-02db-4d24-96c3-88becebecaea None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:40.541340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 92/189] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:40 2022] GET /identity/v3/users/faad5fa92fb14f349b794a81663e7527 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:40.542665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf12fa-b4dd-4aa1-a697-8b75b05cd794 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.543040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf12fa-b4dd-4aa1-a697-8b75b05cd794 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.543320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf12fa-b4dd-4aa1-a697-8b75b05cd794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.559553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-9bbf12fa-b4dd-4aa1-a697-8b75b05cd794 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:40.560737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9bbf12fa-b4dd-4aa1-a697-8b75b05cd794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:40.622911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f166a0-3516-4069-980a-be5c955a45b6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.626423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 93/190] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:40.627185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf12fa-b4dd-4aa1-a697-8b75b05cd794 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:40.658879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44fb3-911f-4cd3-9b00-64f6455f4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:40.660133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44fb3-911f-4cd3-9b00-64f6455f4510 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.660347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44fb3-911f-4cd3-9b00-64f6455f4510 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.660625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba44fb3-911f-4cd3-9b00-64f6455f4510 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.661331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba44fb3-911f-4cd3-9b00-64f6455f4510 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:40.662857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba44fb3-911f-4cd3-9b00-64f6455f4510 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:40.682255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 98/191] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:24:40 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:40.694642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44fb3-911f-4cd3-9b00-64f6455f4510 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:40.747352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf12fa-b4dd-4aa1-a697-8b75b05cd794 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.786400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181be4c9-9855-4eab-90f2-2bbb59a3b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:40.787485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181be4c9-9855-4eab-90f2-2bbb59a3b897 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.787982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181be4c9-9855-4eab-90f2-2bbb59a3b897 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.788693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181be4c9-9855-4eab-90f2-2bbb59a3b897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.814786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba44fb3-911f-4cd3-9b00-64f6455f4510 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.850866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e1bfa-8c55-45dc-a87b-fa708a82bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:40.851696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e1bfa-8c55-45dc-a87b-fa708a82bd94 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:40.852012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e1bfa-8c55-45dc-a87b-fa708a82bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:40.852239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e1bfa-8c55-45dc-a87b-fa708a82bd94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:40.864236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e1bfa-8c55-45dc-a87b-fa708a82bd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:40.870348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181be4c9-9855-4eab-90f2-2bbb59a3b897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:40.872106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181be4c9-9855-4eab-90f2-2bbb59a3b897 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-d18e1bfa-8c55-45dc-a87b-fa708a82bd94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:40.872614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:40.873443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:40.874231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 99/192] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:24:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:40.879984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e1bfa-8c55-45dc-a87b-fa708a82bd94 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:40.988270 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e1bfa-8c55-45dc-a87b-fa708a82bd94 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:40.993256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 94/193] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:40.995580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181be4c9-9855-4eab-90f2-2bbb59a3b897 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:41.039086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:41.039692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.039974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.040248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.040995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:41.041324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:41.044028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:41.056523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 100/194] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:24:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:41.062486 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:41.111730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181be4c9-9855-4eab-90f2-2bbb59a3b897 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:41.151202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a595b4-5975-49e1-8cce-463d51f4e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:41.152068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a595b4-5975-49e1-8cce-463d51f4e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.152345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a595b4-5975-49e1-8cce-463d51f4e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.152619 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a595b4-5975-49e1-8cce-463d51f4e4d6 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.153835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a595b4-5975-49e1-8cce-463d51f4e4d6 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:41.155276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a595b4-5975-49e1-8cce-463d51f4e4d6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:41.161652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 95/195] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:40 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:41.163706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a595b4-5975-49e1-8cce-463d51f4e4d6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:41.193693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d5ad-8947-4b57-ad1d-34404a737c2f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:41.230440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745404a7-0e6f-4555-bc32-40e24b2bbb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:41.231326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745404a7-0e6f-4555-bc32-40e24b2bbb26 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.231610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745404a7-0e6f-4555-bc32-40e24b2bbb26 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.231886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745404a7-0e6f-4555-bc32-40e24b2bbb26 None admin] PATH_INFO: `/v3/users/faad5fa92fb14f349b794a81663e7527` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.233087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745404a7-0e6f-4555-bc32-40e24b2bbb26 None admin] RBAC: Authorizing `identity:get_user(user_id=faad5fa92fb14f349b794a81663e7527)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:41.234637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745404a7-0e6f-4555-bc32-40e24b2bbb26 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:41.236644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 101/196] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:41 2022] GET /identity/v3/users/faad5fa92fb14f349b794a81663e7527 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:41.245870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745404a7-0e6f-4555-bc32-40e24b2bbb26 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:41.277003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a595b4-5975-49e1-8cce-463d51f4e4d6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:41.318493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678d69f-dfd1-45fb-b19d-36400180cd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:41.319071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678d69f-dfd1-45fb-b19d-36400180cd8e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.319354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678d69f-dfd1-45fb-b19d-36400180cd8e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.319628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678d69f-dfd1-45fb-b19d-36400180cd8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.320467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678d69f-dfd1-45fb-b19d-36400180cd8e None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user.id=faad5fa92fb14f349b794a81663e7527) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:41.320778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678d69f-dfd1-45fb-b19d-36400180cd8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:41.322317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678d69f-dfd1-45fb-b19d-36400180cd8e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:41.328423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 96/197] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:41 2022] GET /identity/v3/role_assignments?user.id=faad5fa92fb14f349b794a81663e7527&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=de114c58fdc8476ebab657e6f9359155 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:41.329701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7fc43-a6d1-42f7-a596-cd7d3d5fc7b1 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.329989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7fc43-a6d1-42f7-a596-cd7d3d5fc7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.330262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7fc43-a6d1-42f7-a596-cd7d3d5fc7b1 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.332118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 97/198] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:41.337756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a3b01-90bf-407b-88e9-1e701cc70898 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.338047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a3b01-90bf-407b-88e9-1e701cc70898 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.338326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a3b01-90bf-407b-88e9-1e701cc70898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.356213 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-503a3b01-90bf-407b-88e9-1e701cc70898 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:41.357498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-503a3b01-90bf-407b-88e9-1e701cc70898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:41.395834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745404a7-0e6f-4555-bc32-40e24b2bbb26 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:41.431715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 98/199] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:41.457567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519381c-52ce-439f-bcbc-71f61d7fa3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:41.457567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519381c-52ce-439f-bcbc-71f61d7fa3c9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.457567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519381c-52ce-439f-bcbc-71f61d7fa3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.457567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519381c-52ce-439f-bcbc-71f61d7fa3c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.459352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a3b01-90bf-407b-88e9-1e701cc70898 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:41.582332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519381c-52ce-439f-bcbc-71f61d7fa3c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:41.584402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519381c-52ce-439f-bcbc-71f61d7fa3c9 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:41.618979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a3b01-90bf-407b-88e9-1e701cc70898 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:41.667843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1abc74-7105-44de-ba69-06c12fecb216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:41.668649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1abc74-7105-44de-ba69-06c12fecb216 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.668932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1abc74-7105-44de-ba69-06c12fecb216 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.669656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1abc74-7105-44de-ba69-06c12fecb216 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.680659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1abc74-7105-44de-ba69-06c12fecb216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5c1abc74-7105-44de-ba69-06c12fecb216 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:41.689353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:41.690812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:41.691563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:41.692135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 99/200] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:41.697399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1abc74-7105-44de-ba69-06c12fecb216 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:41.812594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 102/201] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:41.818738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519381c-52ce-439f-bcbc-71f61d7fa3c9 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:41.833509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1abc74-7105-44de-ba69-06c12fecb216 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:41.876942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:41.878650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:41.879154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:41.879434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:41.880196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:41.880505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:41.881950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:41.891132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 100/202] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:41.897570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:41.947862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519381c-52ce-439f-bcbc-71f61d7fa3c9 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:41.999707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1255152-a041-4343-adab-12e7003ae17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:42.001861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1255152-a041-4343-adab-12e7003ae17a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:42.005877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1255152-a041-4343-adab-12e7003ae17a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:42.006376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1255152-a041-4343-adab-12e7003ae17a None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:42.007768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1255152-a041-4343-adab-12e7003ae17a None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:42.009430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1255152-a041-4343-adab-12e7003ae17a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:42.016342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 103/203] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:41 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:42.017759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1255152-a041-4343-adab-12e7003ae17a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:42.070937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a8a18-7ee6-4f44-88a4-16c685984f60 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:42.130247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402220cb-1cc2-49d8-9421-48005b157fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:42.132140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402220cb-1cc2-49d8-9421-48005b157fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:42.133321 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402220cb-1cc2-49d8-9421-48005b157fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:42.133971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402220cb-1cc2-49d8-9421-48005b157fb6 None admin] PATH_INFO: `/v3/users/cec815dd9295451f98af7023fd9d98cc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:42.136415 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402220cb-1cc2-49d8-9421-48005b157fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=cec815dd9295451f98af7023fd9d98cc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:42.138767 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402220cb-1cc2-49d8-9421-48005b157fb6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:42.144050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 101/204] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:41 2022] GET /identity/v3/users/cec815dd9295451f98af7023fd9d98cc => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:42.154456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402220cb-1cc2-49d8-9421-48005b157fb6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:42.159836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1255152-a041-4343-adab-12e7003ae17a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:42.202201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:42.202865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:42.203151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:42.203427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:42.204258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] RBAC: Adding query filter params (role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user.id=faad5fa92fb14f349b794a81663e7527) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:42.204573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:42.206756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:42.229578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 104/205] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:42 2022] GET /identity/v3/role_assignments?user.id=faad5fa92fb14f349b794a81663e7527&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=aa78a08951eb49f78aeda141988844de => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:42.307854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402220cb-1cc2-49d8-9421-48005b157fb6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:42.353726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf581e32-af72-4277-9ad6-a108231d7175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:42.354790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581e32-af72-4277-9ad6-a108231d7175 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:42.355068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581e32-af72-4277-9ad6-a108231d7175 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:42.355343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf581e32-af72-4277-9ad6-a108231d7175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:42.437621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf581e32-af72-4277-9ad6-a108231d7175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:42.439152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf581e32-af72-4277-9ad6-a108231d7175 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:42.540889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 102/206] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:42.546576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:42.665707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46fc1a-255b-4c44-881c-307a31f3166b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:42.708810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef42e9-1459-4b97-97e2-e380d14b509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:42.709632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef42e9-1459-4b97-97e2-e380d14b509c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:42.709914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef42e9-1459-4b97-97e2-e380d14b509c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:42.710185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef42e9-1459-4b97-97e2-e380d14b509c None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:42.711388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef42e9-1459-4b97-97e2-e380d14b509c None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:42.712838 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef42e9-1459-4b97-97e2-e380d14b509c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:42.714553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 105/207] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:42 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:42.720422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf581e32-af72-4277-9ad6-a108231d7175 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:42.819610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf581e32-af72-4277-9ad6-a108231d7175 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:42.858708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570c811-a731-4c33-8dec-2721a6290f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:42.859372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570c811-a731-4c33-8dec-2721a6290f2c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:42.859655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570c811-a731-4c33-8dec-2721a6290f2c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:42.859952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570c811-a731-4c33-8dec-2721a6290f2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:42.860786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570c811-a731-4c33-8dec-2721a6290f2c None admin] RBAC: Adding query filter params (role.id=5637904dab8642e795bb9ced27c7aae8, scope.project.id=52ce4f52f95b46479b0949667e03c0d3, user.id=cec815dd9295451f98af7023fd9d98cc) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:42.861093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570c811-a731-4c33-8dec-2721a6290f2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:42.862584 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570c811-a731-4c33-8dec-2721a6290f2c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:42.868583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 103/208] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:42 2022] GET /identity/v3/role_assignments?user.id=cec815dd9295451f98af7023fd9d98cc&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=5637904dab8642e795bb9ced27c7aae8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:43.622954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd43a9-dbef-4e6f-a61a-06cf9b1c1100 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:43.623503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd43a9-dbef-4e6f-a61a-06cf9b1c1100 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:43.623920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd43a9-dbef-4e6f-a61a-06cf9b1c1100 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:43.625491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 106/209] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:43.633713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec6a8-f3d0-45c9-891c-0493b7ca08c9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:43.634364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec6a8-f3d0-45c9-891c-0493b7ca08c9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:43.634834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ec6a8-f3d0-45c9-891c-0493b7ca08c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:43.650290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90b7f-3204-498b-a802-c65c388b2caa None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:43.651188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90b7f-3204-498b-a802-c65c388b2caa None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:43.651659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb90b7f-3204-498b-a802-c65c388b2caa None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:43.653246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 107/210] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:43.658502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e33ec6a8-f3d0-45c9-891c-0493b7ca08c9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:43.659799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21a501-7e70-41ff-9df8-fabd3d125f65 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:43.660217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e33ec6a8-f3d0-45c9-891c-0493b7ca08c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:43.660506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21a501-7e70-41ff-9df8-fabd3d125f65 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:43.661057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21a501-7e70-41ff-9df8-fabd3d125f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:43.681748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-cd21a501-7e70-41ff-9df8-fabd3d125f65 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:43.683818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cd21a501-7e70-41ff-9df8-fabd3d125f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:43.732227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 104/211] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:43.757856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ec6a8-f3d0-45c9-891c-0493b7ca08c9 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:43.762463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 108/212] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:43.786132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21a501-7e70-41ff-9df8-fabd3d125f65 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:43.857117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ec6a8-f3d0-45c9-891c-0493b7ca08c9 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:43.885220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21a501-7e70-41ff-9df8-fabd3d125f65 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:43.889440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9e527-cf26-4f1f-92da-0406bb109b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:43.890262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9e527-cf26-4f1f-92da-0406bb109b37 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:43.890553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9e527-cf26-4f1f-92da-0406bb109b37 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:43.890828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9e527-cf26-4f1f-92da-0406bb109b37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:43.892003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9e527-cf26-4f1f-92da-0406bb109b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:43.893498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9e527-cf26-4f1f-92da-0406bb109b37 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:43.895318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 105/213] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:43.896379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a0a3-c62b-4ca0-a05c-d4a35d8809b4 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:43.896706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a0a3-c62b-4ca0-a05c-d4a35d8809b4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:43.896984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6a0a3-c62b-4ca0-a05c-d4a35d8809b4 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:43.898632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 106/214] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:43.900538 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6a0a3-c62b-4ca0-a05c-d4a35d8809b4 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:43.926087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cc339-2519-4aa4-87c7-7317a9996382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:43.927124 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc339-2519-4aa4-87c7-7317a9996382 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:43.927413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc339-2519-4aa4-87c7-7317a9996382 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:43.927689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc339-2519-4aa4-87c7-7317a9996382 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:43.937737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cc339-2519-4aa4-87c7-7317a9996382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-247cc339-2519-4aa4-87c7-7317a9996382 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:43.945564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:43.946439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:43.947208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 109/215] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:43.947949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c5a44-a8c2-4fb6-8cfc-4122935e5250 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:43.948288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c5a44-a8c2-4fb6-8cfc-4122935e5250 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:43.948510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c5a44-a8c2-4fb6-8cfc-4122935e5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:43.966682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a07c5a44-a8c2-4fb6-8cfc-4122935e5250 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:43.968055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a07c5a44-a8c2-4fb6-8cfc-4122935e5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:44.001811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6a0a3-c62b-4ca0-a05c-d4a35d8809b4 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:44.037640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 110/216] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:44.037640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c5a44-a8c2-4fb6-8cfc-4122935e5250 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:44.043201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb208432-ac89-4bf3-b430-6a657b04e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:44.043958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208432-ac89-4bf3-b430-6a657b04e087 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:44.044309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208432-ac89-4bf3-b430-6a657b04e087 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:44.044654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208432-ac89-4bf3-b430-6a657b04e087 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:44.045435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb208432-ac89-4bf3-b430-6a657b04e087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:44.046984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb208432-ac89-4bf3-b430-6a657b04e087 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:44.070731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 107/217] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:24:43 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:24:44.071485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb208432-ac89-4bf3-b430-6a657b04e087 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:44.160810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c5a44-a8c2-4fb6-8cfc-4122935e5250 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:44.198322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:44.199252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:44.199740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:44.200155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:44.201140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:44.201627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:44.203206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:44.207233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb208432-ac89-4bf3-b430-6a657b04e087 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:44.217789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 111/218] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:44.218981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:44.249658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87359dac-d62a-40c3-b9f9-6fe771886f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:44.250600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87359dac-d62a-40c3-b9f9-6fe771886f19 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:44.250884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87359dac-d62a-40c3-b9f9-6fe771886f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:44.253790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87359dac-d62a-40c3-b9f9-6fe771886f19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:44.264896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87359dac-d62a-40c3-b9f9-6fe771886f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-87359dac-d62a-40c3-b9f9-6fe771886f19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:44.272923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:44.273812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:44.274582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 108/219] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:44.282389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87359dac-d62a-40c3-b9f9-6fe771886f19 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:44.354930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fbfd0-a819-49dc-a698-fe72831c880c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:44.400617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f981-e305-4613-acea-d51418397104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:44.401497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f981-e305-4613-acea-d51418397104 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:44.401814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f981-e305-4613-acea-d51418397104 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:44.402082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f981-e305-4613-acea-d51418397104 None admin] PATH_INFO: `/v3/users/8101913053b74dd5a330867cf27bc9bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:44.404765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87359dac-d62a-40c3-b9f9-6fe771886f19 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:44.423847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9f981-e305-4613-acea-d51418397104 None admin] RBAC: Authorizing `identity:get_user(user_id=8101913053b74dd5a330867cf27bc9bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:44.426011 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9f981-e305-4613-acea-d51418397104 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:44.427914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 112/220] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:44 2022] GET /identity/v3/users/8101913053b74dd5a330867cf27bc9bf => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:44.436381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f981-e305-4613-acea-d51418397104 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:44.451720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7426-8f50-442d-827d-91a103074851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:44.452401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7426-8f50-442d-827d-91a103074851 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:44.452685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7426-8f50-442d-827d-91a103074851 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:44.452961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7426-8f50-442d-827d-91a103074851 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:44.453741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a7426-8f50-442d-827d-91a103074851 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:44.454221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a7426-8f50-442d-827d-91a103074851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:44.455818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a7426-8f50-442d-827d-91a103074851 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:44.469026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 109/221] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:44.476977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7426-8f50-442d-827d-91a103074851 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:44.560504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f981-e305-4613-acea-d51418397104 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:44.609593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7426-8f50-442d-827d-91a103074851 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:44.628681 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae602-13c0-4bb7-b969-2014aab82f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:44.629357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae602-13c0-4bb7-b969-2014aab82f5a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:44.629670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae602-13c0-4bb7-b969-2014aab82f5a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:44.630005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae602-13c0-4bb7-b969-2014aab82f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:44.654271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f4e2-347b-4e5f-94b5-92b86174cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:44.655499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f4e2-347b-4e5f-94b5-92b86174cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:44.655976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f4e2-347b-4e5f-94b5-92b86174cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:44.656441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714f4e2-347b-4e5f-94b5-92b86174cbd0 None admin] PATH_INFO: `/v3/users/faad5fa92fb14f349b794a81663e7527` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:44.659939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714f4e2-347b-4e5f-94b5-92b86174cbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=faad5fa92fb14f349b794a81663e7527)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:44.665737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714f4e2-347b-4e5f-94b5-92b86174cbd0 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:44.669054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 110/222] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:44 2022] GET /identity/v3/users/faad5fa92fb14f349b794a81663e7527 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:44.672956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f4e2-347b-4e5f-94b5-92b86174cbd0 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:44.731995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ae602-13c0-4bb7-b969-2014aab82f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:44.734196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ae602-13c0-4bb7-b969-2014aab82f5a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:44.795334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714f4e2-347b-4e5f-94b5-92b86174cbd0 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:44.837122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e1791-5491-4296-b13c-e31f6744a9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:44.838233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e1791-5491-4296-b13c-e31f6744a9e2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:44.839559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e1791-5491-4296-b13c-e31f6744a9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:44.839842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e1791-5491-4296-b13c-e31f6744a9e2 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:44.841810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e1791-5491-4296-b13c-e31f6744a9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:44.844241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e1791-5491-4296-b13c-e31f6744a9e2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:44.846315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 111/223] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:44 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:44.854455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e1791-5491-4296-b13c-e31f6744a9e2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:44.859759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 113/224] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:44.865799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae602-13c0-4bb7-b969-2014aab82f5a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:45.032103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae602-13c0-4bb7-b969-2014aab82f5a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:45.040458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e1791-5491-4296-b13c-e31f6744a9e2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:45.081799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3fadb-612f-45f8-8928-e172c3e90bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:45.082961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3fadb-612f-45f8-8928-e172c3e90bb5 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.083388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3fadb-612f-45f8-8928-e172c3e90bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.083772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b65a7-2fa9-45d0-b8fa-6a1c08405805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:45.083957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3fadb-612f-45f8-8928-e172c3e90bb5 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/users/faad5fa92fb14f349b794a81663e7527/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.084777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b65a7-2fa9-45d0-b8fa-6a1c08405805 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.085229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b65a7-2fa9-45d0-b8fa-6a1c08405805 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.085652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b65a7-2fa9-45d0-b8fa-6a1c08405805 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.086678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3fadb-612f-45f8-8928-e172c3e90bb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user_id=faad5fa92fb14f349b794a81663e7527, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:45.087125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b65a7-2fa9-45d0-b8fa-6a1c08405805 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:45.088454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3fadb-612f-45f8-8928-e172c3e90bb5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:45.088694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b65a7-2fa9-45d0-b8fa-6a1c08405805 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:45.090555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 114/225] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:44 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:45.092478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3cc84-aa94-4822-9eb6-ec951bbd3bde None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.093088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3cc84-aa94-4822-9eb6-ec951bbd3bde None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.093492 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3cc84-aa94-4822-9eb6-ec951bbd3bde None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.094921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 115/226] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:45.096400 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3cc84-aa94-4822-9eb6-ec951bbd3bde None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:45.110650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 112/227] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:44 2022] PUT /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/users/faad5fa92fb14f349b794a81663e7527/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:45.117563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8671-cb60-489d-8669-d4201058de7a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.117563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8671-cb60-489d-8669-d4201058de7a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.117563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8671-cb60-489d-8669-d4201058de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.144191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5ddc8671-cb60-489d-8669-d4201058de7a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:45.145738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5ddc8671-cb60-489d-8669-d4201058de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:45.229945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 113/228] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:45.253375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8671-cb60-489d-8669-d4201058de7a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:45.340237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3cc84-aa94-4822-9eb6-ec951bbd3bde None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:45.356509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8671-cb60-489d-8669-d4201058de7a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:45.383643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:45.384545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.384991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.385413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.386425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] RBAC: Adding query filter params (role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user.id=8101913053b74dd5a330867cf27bc9bf) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:45.386896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:45.388467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:45.391465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3109534-d42f-4144-b8df-69bcbc23a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:45.392496 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3109534-d42f-4144-b8df-69bcbc23a018 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.392986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3109534-d42f-4144-b8df-69bcbc23a018 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.394088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3109534-d42f-4144-b8df-69bcbc23a018 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.400751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 116/229] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:45 2022] GET /identity/v3/role_assignments?user.id=8101913053b74dd5a330867cf27bc9bf&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:45.410719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3109534-d42f-4144-b8df-69bcbc23a018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e3109534-d42f-4144-b8df-69bcbc23a018 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:45.419732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:45.420690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:45.421455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:45.424682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 114/230] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:45.430569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:45.557368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f208e8-6968-4549-a49e-72cd8b678757 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:45.606329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:45.607083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.607365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.607684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.608463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:45.608771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:45.610228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:45.625996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 117/231] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:45.632207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3109534-d42f-4144-b8df-69bcbc23a018 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:45.759674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3109534-d42f-4144-b8df-69bcbc23a018 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:45.793367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb879a31-b778-4697-a335-f5b17f525fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:45.794278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879a31-b778-4697-a335-f5b17f525fbb None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.794564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879a31-b778-4697-a335-f5b17f525fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.794838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879a31-b778-4697-a335-f5b17f525fbb None admin] PATH_INFO: `/v3/users/faad5fa92fb14f349b794a81663e7527` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.796057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb879a31-b778-4697-a335-f5b17f525fbb None admin] RBAC: Authorizing `identity:get_user(user_id=faad5fa92fb14f349b794a81663e7527)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:45.797608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb879a31-b778-4697-a335-f5b17f525fbb None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:45.800057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 115/232] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:45 2022] GET /identity/v3/users/faad5fa92fb14f349b794a81663e7527 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:45.805376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:45.912204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2a48b-f121-4cf3-a867-45bc5264a43d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:45.945895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0ee2-b24a-4db4-8c91-43c6c967037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:45.946776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0ee2-b24a-4db4-8c91-43c6c967037a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:45.947057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0ee2-b24a-4db4-8c91-43c6c967037a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:45.947332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0ee2-b24a-4db4-8c91-43c6c967037a None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:45.948510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e0ee2-b24a-4db4-8c91-43c6c967037a None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:45.949999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e0ee2-b24a-4db4-8c91-43c6c967037a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:45.951872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 118/233] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:45 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:45.957595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb879a31-b778-4697-a335-f5b17f525fbb None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:46.085881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb879a31-b778-4697-a335-f5b17f525fbb None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:46.120110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e54b3d-7d12-478f-8605-a801e70c74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:46.121003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e54b3d-7d12-478f-8605-a801e70c74bf None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:46.121284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e54b3d-7d12-478f-8605-a801e70c74bf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:46.121576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e54b3d-7d12-478f-8605-a801e70c74bf None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/users/faad5fa92fb14f349b794a81663e7527/roles/aa78a08951eb49f78aeda141988844de` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:46.123948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e54b3d-7d12-478f-8605-a801e70c74bf None admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user_id=faad5fa92fb14f349b794a81663e7527, role_id=aa78a08951eb49f78aeda141988844de)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:46.125421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e54b3d-7d12-478f-8605-a801e70c74bf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:46.153064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 116/234] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:45 2022] PUT /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/users/faad5fa92fb14f349b794a81663e7527/roles/aa78a08951eb49f78aeda141988844de => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:47.007353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56b13-86c3-43bd-9970-a57dbfcaff4e None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.008047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56b13-86c3-43bd-9970-a57dbfcaff4e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.008047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56b13-86c3-43bd-9970-a57dbfcaff4e None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.009604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 119/235] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:47.015862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65451fe-6eb1-48db-ba06-94fae9a3debf None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.016406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65451fe-6eb1-48db-ba06-94fae9a3debf None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.016556 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65451fe-6eb1-48db-ba06-94fae9a3debf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.049966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b65451fe-6eb1-48db-ba06-94fae9a3debf None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:47.051265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b65451fe-6eb1-48db-ba06-94fae9a3debf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:47.084700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318e916-8606-4b5f-8aba-b2f1569c562d None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.085018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318e916-8606-4b5f-8aba-b2f1569c562d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.085254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318e916-8606-4b5f-8aba-b2f1569c562d None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.086901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 120/236] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:47.091850 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599fae-8d33-4b78-9554-b2d69a61ff10 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.092134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599fae-8d33-4b78-9554-b2d69a61ff10 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.092412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599fae-8d33-4b78-9554-b2d69a61ff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.111413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a7599fae-8d33-4b78-9554-b2d69a61ff10 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:47.112635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a7599fae-8d33-4b78-9554-b2d69a61ff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:47.192207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 117/237] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:47.195735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 121/238] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:47.219000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65451fe-6eb1-48db-ba06-94fae9a3debf None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:47.231137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599fae-8d33-4b78-9554-b2d69a61ff10 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:47.426273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599fae-8d33-4b78-9554-b2d69a61ff10 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:47.460293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65451fe-6eb1-48db-ba06-94fae9a3debf None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:47.466244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba065a-00a2-4bf3-aaa4-30b2cd580fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:47.467993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba065a-00a2-4bf3-aaa4-30b2cd580fdf None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.468451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba065a-00a2-4bf3-aaa4-30b2cd580fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.468890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba065a-00a2-4bf3-aaa4-30b2cd580fdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.470245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba065a-00a2-4bf3-aaa4-30b2cd580fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:47.471875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba065a-00a2-4bf3-aaa4-30b2cd580fdf None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:47.474131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 122/239] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:47.480753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba065a-00a2-4bf3-aaa4-30b2cd580fdf None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:47.534936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452102f-8b32-40d5-8296-33846ca91aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:47.535747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452102f-8b32-40d5-8296-33846ca91aed None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.536083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452102f-8b32-40d5-8296-33846ca91aed None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.536366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452102f-8b32-40d5-8296-33846ca91aed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.558721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452102f-8b32-40d5-8296-33846ca91aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-4452102f-8b32-40d5-8296-33846ca91aed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:47.575646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:47.576563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:47.577327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 118/240] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:47.583371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452102f-8b32-40d5-8296-33846ca91aed None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:47.604472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba065a-00a2-4bf3-aaa4-30b2cd580fdf None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:47.639449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0b32d-7950-4170-ad39-6e78c68b8bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:47.640508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0b32d-7950-4170-ad39-6e78c68b8bc7 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.640989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0b32d-7950-4170-ad39-6e78c68b8bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.641454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0b32d-7950-4170-ad39-6e78c68b8bc7 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.645380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0b32d-7950-4170-ad39-6e78c68b8bc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:47.651153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0b32d-7950-4170-ad39-6e78c68b8bc7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:47.709455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 123/241] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:24:47 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:47.731342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452102f-8b32-40d5-8296-33846ca91aed None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:47.770439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:47.771115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.771392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.771662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.772406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:47.772710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:47.774143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:47.783411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 119/242] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:47.789087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0b32d-7950-4170-ad39-6e78c68b8bc7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:47.901473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0b32d-7950-4170-ad39-6e78c68b8bc7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:47.952683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe633667-78b8-47eb-bf0e-480b76d19612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:47.953902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633667-78b8-47eb-bf0e-480b76d19612 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:47.954322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633667-78b8-47eb-bf0e-480b76d19612 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:47.954731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633667-78b8-47eb-bf0e-480b76d19612 None admin] PATH_INFO: `/v3/users/efe17de7006b460891f711e2f7f3ed24` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:47.976663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe633667-78b8-47eb-bf0e-480b76d19612 None admin] RBAC: Authorizing `identity:get_user(user_id=efe17de7006b460891f711e2f7f3ed24)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:47.978126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe633667-78b8-47eb-bf0e-480b76d19612 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:47.979883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 124/243] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:47 2022] GET /identity/v3/users/efe17de7006b460891f711e2f7f3ed24 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:47.985560 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:48.130978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828731a-d392-45d4-9979-c7ad55f776d4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:48.155653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cdc-6b7f-44b5-ba6c-39e5d87f50e0 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.156622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cdc-6b7f-44b5-ba6c-39e5d87f50e0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.156960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df6cdc-6b7f-44b5-ba6c-39e5d87f50e0 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.160064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 125/244] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:48.165737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27f0b-1919-40a6-b0f0-ed9ae623592b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.166289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27f0b-1919-40a6-b0f0-ed9ae623592b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.166777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27f0b-1919-40a6-b0f0-ed9ae623592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.176789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f9d8-3501-47df-8968-3ed14921e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:48.177440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f9d8-3501-47df-8968-3ed14921e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.177750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f9d8-3501-47df-8968-3ed14921e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.178026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f9d8-3501-47df-8968-3ed14921e2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.194996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-37d27f0b-1919-40a6-b0f0-ed9ae623592b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:48.196535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-37d27f0b-1919-40a6-b0f0-ed9ae623592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:48.252775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f9d8-3501-47df-8968-3ed14921e2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:48.254505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f9d8-3501-47df-8968-3ed14921e2f5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:48.293884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 126/245] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:48.318442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d27f0b-1919-40a6-b0f0-ed9ae623592b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:48.390245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 120/246] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:48.395614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ccc2-265c-4e88-a03a-95a6e73a0b35 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.395916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ccc2-265c-4e88-a03a-95a6e73a0b35 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.396202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ccc2-265c-4e88-a03a-95a6e73a0b35 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.398661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 121/247] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:48.399393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7ccc2-265c-4e88-a03a-95a6e73a0b35 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:48.490076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d27f0b-1919-40a6-b0f0-ed9ae623592b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:48.530985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02426d-d09d-42d6-9f92-2a6a41085f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:48.532112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02426d-d09d-42d6-9f92-2a6a41085f79 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.533678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02426d-d09d-42d6-9f92-2a6a41085f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.535847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02426d-d09d-42d6-9f92-2a6a41085f79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.562179 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02426d-d09d-42d6-9f92-2a6a41085f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-0c02426d-d09d-42d6-9f92-2a6a41085f79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:48.570546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:48.571416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:24:48.572194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:48.575175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 127/248] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:48.576738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c38e-ace7-4a54-947b-6a39bba2270e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.577233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c38e-ace7-4a54-947b-6a39bba2270e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.577847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c38e-ace7-4a54-947b-6a39bba2270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.603677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1575c38e-ace7-4a54-947b-6a39bba2270e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:48.606462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1575c38e-ace7-4a54-947b-6a39bba2270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:48.627687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7ccc2-265c-4e88-a03a-95a6e73a0b35 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:48.697224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b9fb5-f1ba-44ed-aef8-52a4ec88a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:48.699999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9fb5-f1ba-44ed-aef8-52a4ec88a762 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.700559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9fb5-f1ba-44ed-aef8-52a4ec88a762 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.701056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9fb5-f1ba-44ed-aef8-52a4ec88a762 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.703643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b9fb5-f1ba-44ed-aef8-52a4ec88a762 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:48.709039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b9fb5-f1ba-44ed-aef8-52a4ec88a762 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:48.711364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 122/249] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:48 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:48.713654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b9fb5-f1ba-44ed-aef8-52a4ec88a762 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:48.736126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 128/250] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:48.737054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c38e-ace7-4a54-947b-6a39bba2270e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:48.817889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b9fb5-f1ba-44ed-aef8-52a4ec88a762 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:48.858415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c38e-ace7-4a54-947b-6a39bba2270e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:48.863219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:48.863904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.864185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.864463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.865226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:48.865550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:48.866944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:48.883909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 123/251] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:48.884655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:48.902398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:48.903329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:48.903773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:48.904211 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:48.905173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] RBAC: Adding query filter params (role.id=5637904dab8642e795bb9ced27c7aae8, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user.id=efe17de7006b460891f711e2f7f3ed24) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:48.905662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:48.907233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:48.912901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 129/252] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:48 2022] GET /identity/v3/role_assignments?user.id=efe17de7006b460891f711e2f7f3ed24&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=5637904dab8642e795bb9ced27c7aae8 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:48.913801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:49.071471 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12928bf-6d96-4588-933b-be91e4a8c060 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:49.104573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b97c1e-1fca-4d34-a9be-de084ba8d311 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:49.138999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7db19-a47f-46f0-a341-fb8dac996071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:49.139809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7db19-a47f-46f0-a341-fb8dac996071 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:49.140101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7db19-a47f-46f0-a341-fb8dac996071 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:49.140380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7db19-a47f-46f0-a341-fb8dac996071 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:49.156966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7db19-a47f-46f0-a341-fb8dac996071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-0cb7db19-a47f-46f0-a341-fb8dac996071 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:49.164940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:49.165865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:49.166636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:49.167208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 124/253] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:49.169437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda30ff-ae89-4dc6-8ad1-11addc8e7c98 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:49.171392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca867a6-50e0-491b-a1b5-199d94e76d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:49.172274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca867a6-50e0-491b-a1b5-199d94e76d83 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:49.172555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca867a6-50e0-491b-a1b5-199d94e76d83 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:49.172830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca867a6-50e0-491b-a1b5-199d94e76d83 None admin] PATH_INFO: `/v3/users/faad5fa92fb14f349b794a81663e7527` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:49.174070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca867a6-50e0-491b-a1b5-199d94e76d83 None admin] RBAC: Authorizing `identity:get_user(user_id=faad5fa92fb14f349b794a81663e7527)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:49.175566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca867a6-50e0-491b-a1b5-199d94e76d83 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:49.177205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 130/254] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:48 2022] GET /identity/v3/users/faad5fa92fb14f349b794a81663e7527 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:49.177847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda30ff-ae89-4dc6-8ad1-11addc8e7c98 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:49.178027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca867a6-50e0-491b-a1b5-199d94e76d83 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:49.178536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda30ff-ae89-4dc6-8ad1-11addc8e7c98 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:49.180166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 125/255] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:49 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:49.182476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda30ff-ae89-4dc6-8ad1-11addc8e7c98 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:49.320208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda30ff-ae89-4dc6-8ad1-11addc8e7c98 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:49.367630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca867a6-50e0-491b-a1b5-199d94e76d83 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:49.375902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a004e0-da73-41a2-b6d7-2162e8efcf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:49.376549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a004e0-da73-41a2-b6d7-2162e8efcf5c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:49.376824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a004e0-da73-41a2-b6d7-2162e8efcf5c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:49.377091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a004e0-da73-41a2-b6d7-2162e8efcf5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:49.430261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823a6b4-6741-49c9-a267-3b5c10c9e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:49.430942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a6b4-6741-49c9-a267-3b5c10c9e345 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:49.431229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a6b4-6741-49c9-a267-3b5c10c9e345 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:49.431503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823a6b4-6741-49c9-a267-3b5c10c9e345 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:49.432253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823a6b4-6741-49c9-a267-3b5c10c9e345 None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:49.432562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823a6b4-6741-49c9-a267-3b5c10c9e345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:49.434114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823a6b4-6741-49c9-a267-3b5c10c9e345 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:49.446475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a004e0-da73-41a2-b6d7-2162e8efcf5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:49.447932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a004e0-da73-41a2-b6d7-2162e8efcf5c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:49.457003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 131/256] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:49.458087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80b288-a048-497c-8ccb-3a7b68fdd51a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:49.458429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80b288-a048-497c-8ccb-3a7b68fdd51a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:49.458714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80b288-a048-497c-8ccb-3a7b68fdd51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:49.499155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ec80b288-a048-497c-8ccb-3a7b68fdd51a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:49.500367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ec80b288-a048-497c-8ccb-3a7b68fdd51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:49.590131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 132/257] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:49.591002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80b288-a048-497c-8ccb-3a7b68fdd51a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:49.610147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 126/258] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:24:49.626924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a004e0-da73-41a2-b6d7-2162e8efcf5c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:49.739450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80b288-a048-497c-8ccb-3a7b68fdd51a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:49.776595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e6aa1-5610-4025-86ad-9164de2b773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:49.777467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6aa1-5610-4025-86ad-9164de2b773c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:49.777774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6aa1-5610-4025-86ad-9164de2b773c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:49.778045 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e6aa1-5610-4025-86ad-9164de2b773c None admin] PATH_INFO: `/v3/users/8101913053b74dd5a330867cf27bc9bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:49.779990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e6aa1-5610-4025-86ad-9164de2b773c None admin] RBAC: Authorizing `identity:get_user(user_id=8101913053b74dd5a330867cf27bc9bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:49.781457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e6aa1-5610-4025-86ad-9164de2b773c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:49.783117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 133/259] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:49 2022] GET /identity/v3/users/8101913053b74dd5a330867cf27bc9bf => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:49.784400 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e6aa1-5610-4025-86ad-9164de2b773c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:49.817391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a004e0-da73-41a2-b6d7-2162e8efcf5c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:49.884010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f0e7-9aad-44c6-b820-172407e8458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:49.884748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f0e7-9aad-44c6-b820-172407e8458a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:49.885028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f0e7-9aad-44c6-b820-172407e8458a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:49.885301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457f0e7-9aad-44c6-b820-172407e8458a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:49.906424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457f0e7-9aad-44c6-b820-172407e8458a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5457f0e7-9aad-44c6-b820-172407e8458a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:49.915114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:49.915941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:24:49.916701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:49.929767 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 127/260] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:24:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:49.930402 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f0e7-9aad-44c6-b820-172407e8458a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:49.963341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e6aa1-5610-4025-86ad-9164de2b773c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:49.999470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcba49-e72c-4775-b252-0fcdaf4a5b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:50.000342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcba49-e72c-4775-b252-0fcdaf4a5b2c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.000623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcba49-e72c-4775-b252-0fcdaf4a5b2c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.000897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcba49-e72c-4775-b252-0fcdaf4a5b2c None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.002780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcba49-e72c-4775-b252-0fcdaf4a5b2c None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:50.004235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcba49-e72c-4775-b252-0fcdaf4a5b2c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:50.005970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 134/261] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:49 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:50.006742 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcba49-e72c-4775-b252-0fcdaf4a5b2c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:50.122519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcba49-e72c-4775-b252-0fcdaf4a5b2c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:50.164020 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:50.164698 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.165682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.167912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457f0e7-9aad-44c6-b820-172407e8458a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:50.168782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.169567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:50.169885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:50.171273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:50.188851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 135/262] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:24:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:50.191346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:50.240644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f231d04-b911-42a3-abae-85f5d67a1b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:50.241530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f231d04-b911-42a3-abae-85f5d67a1b97 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.241834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f231d04-b911-42a3-abae-85f5d67a1b97 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.242295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f231d04-b911-42a3-abae-85f5d67a1b97 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.245326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f231d04-b911-42a3-abae-85f5d67a1b97 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:50.246830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f231d04-b911-42a3-abae-85f5d67a1b97 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:50.253511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 128/263] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:49 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:50.254369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f231d04-b911-42a3-abae-85f5d67a1b97 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:50.344911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb71e21-2703-4278-a4bc-ad688a17bfa9 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:50.384754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:50.386263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.386548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.386820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.387649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user.id=faad5fa92fb14f349b794a81663e7527) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:50.387957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:50.389414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:50.404251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 136/264] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:50 2022] GET /identity/v3/role_assignments?user.id=faad5fa92fb14f349b794a81663e7527&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=de114c58fdc8476ebab657e6f9359155 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:50.414455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:50.459664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f231d04-b911-42a3-abae-85f5d67a1b97 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:50.567476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83d029-6949-44e4-b6b4-e6b2e175084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:50.568388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d029-6949-44e4-b6b4-e6b2e175084a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.568672 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d029-6949-44e4-b6b4-e6b2e175084a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.568947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d029-6949-44e4-b6b4-e6b2e175084a None admin] PATH_INFO: `/v3/users/faad5fa92fb14f349b794a81663e7527` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.570279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83d029-6949-44e4-b6b4-e6b2e175084a None admin] RBAC: Authorizing `identity:get_user(user_id=faad5fa92fb14f349b794a81663e7527)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:50.571807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83d029-6949-44e4-b6b4-e6b2e175084a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:50.578064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 129/265] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:50 2022] GET /identity/v3/users/faad5fa92fb14f349b794a81663e7527 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:50.584371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83d029-6949-44e4-b6b4-e6b2e175084a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:50.739604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1676fa-42de-497c-802d-1c249c6e92ab None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:50.751833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83d029-6949-44e4-b6b4-e6b2e175084a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:50.793391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40614e4e-b5c6-462c-af98-10901ecac237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:50.794331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614e4e-b5c6-462c-af98-10901ecac237 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.794610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614e4e-b5c6-462c-af98-10901ecac237 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.794885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614e4e-b5c6-462c-af98-10901ecac237 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/users/8101913053b74dd5a330867cf27bc9bf/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.796862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40614e4e-b5c6-462c-af98-10901ecac237 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user_id=8101913053b74dd5a330867cf27bc9bf, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:50.797138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a6e9-1c10-4cd9-a231-8389d57651b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:50.798023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a6e9-1c10-4cd9-a231-8389d57651b0 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.798369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40614e4e-b5c6-462c-af98-10901ecac237 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:50.798727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a6e9-1c10-4cd9-a231-8389d57651b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.799182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a6e9-1c10-4cd9-a231-8389d57651b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.815861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 137/266] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:50 2022] PUT /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/users/8101913053b74dd5a330867cf27bc9bf/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:50.817558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b77b4-adc5-4a6c-b3df-02720c3ea49e None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.818510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b77b4-adc5-4a6c-b3df-02720c3ea49e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.818690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b77b4-adc5-4a6c-b3df-02720c3ea49e None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.820296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 138/267] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:50.821452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f64e99-73f4-4afb-83fd-09c3df9153e3 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.822993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f64e99-73f4-4afb-83fd-09c3df9153e3 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.822993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f64e99-73f4-4afb-83fd-09c3df9153e3 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.826358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 139/268] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:50.826358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c4a0-089f-411a-907a-1d5b01a5c7b0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.826358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c4a0-089f-411a-907a-1d5b01a5c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.826622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c4a0-089f-411a-907a-1d5b01a5c7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.848579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1d65c4a0-089f-411a-907a-1d5b01a5c7b0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:50.850161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1d65c4a0-089f-411a-907a-1d5b01a5c7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:50.922637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37a6e9-1c10-4cd9-a231-8389d57651b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:50.925718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37a6e9-1c10-4cd9-a231-8389d57651b0 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:50.938094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 140/269] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:50.942145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2abaf1-9a39-42b7-a3c0-03cad69c3e70 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:50.942446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2abaf1-9a39-42b7-a3c0-03cad69c3e70 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:50.942698 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2abaf1-9a39-42b7-a3c0-03cad69c3e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:50.962973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ce2abaf1-9a39-42b7-a3c0-03cad69c3e70 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:50.964162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ce2abaf1-9a39-42b7-a3c0-03cad69c3e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:51.050295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 141/270] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:51.050972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2abaf1-9a39-42b7-a3c0-03cad69c3e70 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.057147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 130/271] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:24:51.063071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a6e9-1c10-4cd9-a231-8389d57651b0 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.166058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2abaf1-9a39-42b7-a3c0-03cad69c3e70 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.175450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a6e9-1c10-4cd9-a231-8389d57651b0 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.209845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b5613-25ee-4824-8b0d-08668da05c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:51.211054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5613-25ee-4824-8b0d-08668da05c00 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.211407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1594c31-ce20-42eb-b0ef-9bdde7e3e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:51.212012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5613-25ee-4824-8b0d-08668da05c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.212403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1594c31-ce20-42eb-b0ef-9bdde7e3e5af None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.212700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5613-25ee-4824-8b0d-08668da05c00 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.212857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1594c31-ce20-42eb-b0ef-9bdde7e3e5af None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.213244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1594c31-ce20-42eb-b0ef-9bdde7e3e5af None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.214331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b5613-25ee-4824-8b0d-08668da05c00 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:51.216375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b5613-25ee-4824-8b0d-08668da05c00 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:51.218801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 131/272] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:51 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:51.219693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b5613-25ee-4824-8b0d-08668da05c00 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.230678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1594c31-ce20-42eb-b0ef-9bdde7e3e5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-d1594c31-ce20-42eb-b0ef-9bdde7e3e5af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:51.241573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:51.242506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:51.243273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 142/273] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:51.243894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1594c31-ce20-42eb-b0ef-9bdde7e3e5af None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.342028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b5613-25ee-4824-8b0d-08668da05c00 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.366537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1594c31-ce20-42eb-b0ef-9bdde7e3e5af None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.386483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed305b-ceb7-474c-b468-35b439b2fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:51.387635 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed305b-ceb7-474c-b468-35b439b2fd03 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.388089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed305b-ceb7-474c-b468-35b439b2fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.388530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed305b-ceb7-474c-b468-35b439b2fd03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.390028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed305b-ceb7-474c-b468-35b439b2fd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:51.391780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed305b-ceb7-474c-b468-35b439b2fd03 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:51.394059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 132/274] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:51.395138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed305b-ceb7-474c-b468-35b439b2fd03 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.411765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:51.412808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.413199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.413579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.414705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] RBAC: Adding query filter params (role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user.id=faad5fa92fb14f349b794a81663e7527) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:51.415124 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:51.416974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:51.426073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 143/275] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:51 2022] GET /identity/v3/role_assignments?user.id=faad5fa92fb14f349b794a81663e7527&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=aa78a08951eb49f78aeda141988844de => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:51.430086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.581707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed305b-ceb7-474c-b468-35b439b2fd03 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.598405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe16daa-707a-471d-984b-987146c4d2a9 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.617822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cb1f4-ef5a-4c01-9b98-5466bba61a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:51.618497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cb1f4-ef5a-4c01-9b98-5466bba61a74 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.618775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cb1f4-ef5a-4c01-9b98-5466bba61a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.619046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cb1f4-ef5a-4c01-9b98-5466bba61a74 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.619798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cb1f4-ef5a-4c01-9b98-5466bba61a74 None admin] RBAC: Adding query filter params (name=member) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:51.620101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cb1f4-ef5a-4c01-9b98-5466bba61a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:51.621488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cb1f4-ef5a-4c01-9b98-5466bba61a74 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:51.635274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 133/276] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:51.636698 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f102ca-d308-4c22-8520-bfc97cf9dd97 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.636958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f102ca-d308-4c22-8520-bfc97cf9dd97 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.637235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f102ca-d308-4c22-8520-bfc97cf9dd97 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.638800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 134/277] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:51.639590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecf278-4bd9-4e6c-a362-226b5a76ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:51.640266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecf278-4bd9-4e6c-a362-226b5a76ed6a None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.640549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecf278-4bd9-4e6c-a362-226b5a76ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.640822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecf278-4bd9-4e6c-a362-226b5a76ed6a None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.641554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecf278-4bd9-4e6c-a362-226b5a76ed6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:51.643578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecf278-4bd9-4e6c-a362-226b5a76ed6a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:51.643912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f102ca-d308-4c22-8520-bfc97cf9dd97 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.667166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 144/278] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:24:51 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:51.668321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5f9b1-58a3-4c07-9af4-7cc0abfa1741 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.668609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5f9b1-58a3-4c07-9af4-7cc0abfa1741 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.668891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5f9b1-58a3-4c07-9af4-7cc0abfa1741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.689918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-06f5f9b1-58a3-4c07-9af4-7cc0abfa1741 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:51.691692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-06f5f9b1-58a3-4c07-9af4-7cc0abfa1741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:51.787830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 145/279] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:51.790428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f102ca-d308-4c22-8520-bfc97cf9dd97 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.810642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5f9b1-58a3-4c07-9af4-7cc0abfa1741 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.827443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ea328-d17a-4fe3-a124-9e384a77a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:51.828628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ea328-d17a-4fe3-a124-9e384a77a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.829121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ea328-d17a-4fe3-a124-9e384a77a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.829585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ea328-d17a-4fe3-a124-9e384a77a5e5 None admin] PATH_INFO: `/v3/users/276ec86be6234ccabf1003f0a4a47793` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:51.845730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ea328-d17a-4fe3-a124-9e384a77a5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=276ec86be6234ccabf1003f0a4a47793)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:51.847602 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ea328-d17a-4fe3-a124-9e384a77a5e5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:51.849957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 135/280] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:51 2022] GET /identity/v3/users/276ec86be6234ccabf1003f0a4a47793 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:51.857118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ea328-d17a-4fe3-a124-9e384a77a5e5 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:51.944536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5f9b1-58a3-4c07-9af4-7cc0abfa1741 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.968640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ea328-d17a-4fe3-a124-9e384a77a5e5 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:51.982630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901c876-8291-4693-a278-2a648649a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:51.983812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c876-8291-4693-a278-2a648649a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:51.984102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c876-8291-4693-a278-2a648649a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:51.984380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901c876-8291-4693-a278-2a648649a1e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:52.004059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901c876-8291-4693-a278-2a648649a1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-a901c876-8291-4693-a278-2a648649a1e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:52.011872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:52.012731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:52.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:52.016042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:52.016940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:52.017414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:52.017662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 146/281] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:52.018717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:52.019708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901c876-8291-4693-a278-2a648649a1e2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:52.019937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] RBAC: Adding query filter params (role.id=e6b936a5820f443fb9310f7cdfe7a1f6, user.id=276ec86be6234ccabf1003f0a4a47793, scope.system=all) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:52.020500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:52.022156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:52.029865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 136/282] 10.222.0.36 () {56 vars in 1308 bytes} [Wed May 11 07:24:51 2022] GET /identity/v3/role_assignments?user.id=276ec86be6234ccabf1003f0a4a47793&scope.system=all&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:52.151837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901c876-8291-4693-a278-2a648649a1e2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:52.189217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:52.190449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:52.190731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:52.190999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:52.191753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] RBAC: Adding query filter params (name=reader) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:52.192060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:52.193591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:52.202795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 147/283] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:52.209366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:52.310319 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df674-fd2e-4d31-9f4b-72a8ab3e635a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:52.344751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff58ea-f2da-4198-b3d6-d4f1679c0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:52.345648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff58ea-f2da-4198-b3d6-d4f1679c0120 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:52.345929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff58ea-f2da-4198-b3d6-d4f1679c0120 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:52.346743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff58ea-f2da-4198-b3d6-d4f1679c0120 None admin] PATH_INFO: `/v3/users/efe17de7006b460891f711e2f7f3ed24` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:52.347944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff58ea-f2da-4198-b3d6-d4f1679c0120 None admin] RBAC: Authorizing `identity:get_user(user_id=efe17de7006b460891f711e2f7f3ed24)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:52.349374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff58ea-f2da-4198-b3d6-d4f1679c0120 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:52.351204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 137/284] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:52 2022] GET /identity/v3/users/efe17de7006b460891f711e2f7f3ed24 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:52.356641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:52.460269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eba97-54ae-4aa9-8f27-cfebc5edf75e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:52.505929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70ae5-3dfa-4bdd-bf1b-33641eff4794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:52.506785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70ae5-3dfa-4bdd-bf1b-33641eff4794 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:52.507065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70ae5-3dfa-4bdd-bf1b-33641eff4794 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:52.507336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70ae5-3dfa-4bdd-bf1b-33641eff4794 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:52.511745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70ae5-3dfa-4bdd-bf1b-33641eff4794 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:52.513203 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70ae5-3dfa-4bdd-bf1b-33641eff4794 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:52.514925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 148/285] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:52 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:52.521181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff58ea-f2da-4198-b3d6-d4f1679c0120 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:52.641193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff58ea-f2da-4198-b3d6-d4f1679c0120 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:52.674330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257a456-2e37-4826-8a7b-5040ccf653ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:52.675222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257a456-2e37-4826-8a7b-5040ccf653ec None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:52.675500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257a456-2e37-4826-8a7b-5040ccf653ec None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:52.675766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257a456-2e37-4826-8a7b-5040ccf653ec None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/users/efe17de7006b460891f711e2f7f3ed24/roles/5637904dab8642e795bb9ced27c7aae8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:52.677753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257a456-2e37-4826-8a7b-5040ccf653ec None admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user_id=efe17de7006b460891f711e2f7f3ed24, role_id=5637904dab8642e795bb9ced27c7aae8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:52.679271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257a456-2e37-4826-8a7b-5040ccf653ec None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:52.702701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 138/286] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:24:52 2022] PUT /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/users/efe17de7006b460891f711e2f7f3ed24/roles/5637904dab8642e795bb9ced27c7aae8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:53.297666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9553f-009a-49bc-873f-462808cedc48 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:53.298041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9553f-009a-49bc-873f-462808cedc48 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:53.298219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9553f-009a-49bc-873f-462808cedc48 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:53.299929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 149/287] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:53.304905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81954-6c60-48cf-8557-970c97ee096b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:53.305344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81954-6c60-48cf-8557-970c97ee096b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:53.305516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c81954-6c60-48cf-8557-970c97ee096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:53.326528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-04c81954-6c60-48cf-8557-970c97ee096b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:53.327710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-04c81954-6c60-48cf-8557-970c97ee096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:53.407888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 139/288] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:53.439167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9553f-009a-49bc-873f-462808cedc48 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:53.564340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9553f-009a-49bc-873f-462808cedc48 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:53.599275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa3842-905d-4d73-a088-03ed596ce51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:53.600379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa3842-905d-4d73-a088-03ed596ce51a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:53.600805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa3842-905d-4d73-a088-03ed596ce51a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:53.601219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa3842-905d-4d73-a088-03ed596ce51a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:53.613294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa3842-905d-4d73-a088-03ed596ce51a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-5cfa3842-905d-4d73-a088-03ed596ce51a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:53.621350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:53.622440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:53.623409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:53.625736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 150/289] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:53.631690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81954-6c60-48cf-8557-970c97ee096b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:53.808638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c81954-6c60-48cf-8557-970c97ee096b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:53.856917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:53.857506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:53.857818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:53.858092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:53.858837 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] RBAC: Adding query filter params (name=member) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:53.859142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:53.860512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:53.872623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 140/290] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:53.878809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa3842-905d-4d73-a088-03ed596ce51a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:53.981110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa3842-905d-4d73-a088-03ed596ce51a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:54.020932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717c38-a585-4923-aa7e-b171941874eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:54.021889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717c38-a585-4923-aa7e-b171941874eb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:54.022174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717c38-a585-4923-aa7e-b171941874eb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:54.022449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717c38-a585-4923-aa7e-b171941874eb None admin] PATH_INFO: `/v3/users/8101913053b74dd5a330867cf27bc9bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:54.023679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717c38-a585-4923-aa7e-b171941874eb None admin] RBAC: Authorizing `identity:get_user(user_id=8101913053b74dd5a330867cf27bc9bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:54.025124 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717c38-a585-4923-aa7e-b171941874eb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:54.026765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 151/291] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:53 2022] GET /identity/v3/users/8101913053b74dd5a330867cf27bc9bf => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:54.032259 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:54.188189 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338d3c-0291-4e59-a4b7-7113e71ca756 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:54.235187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6a692-c067-498d-928a-034bad3b4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:54.236255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6a692-c067-498d-928a-034bad3b4360 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:54.236785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6a692-c067-498d-928a-034bad3b4360 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:54.237759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6a692-c067-498d-928a-034bad3b4360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:54.330114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6a692-c067-498d-928a-034bad3b4360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:54.331669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6a692-c067-498d-928a-034bad3b4360 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:54.432859 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 141/292] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:54.438793 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717c38-a585-4923-aa7e-b171941874eb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:54.543062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717c38-a585-4923-aa7e-b171941874eb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:54.581040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71a02f-d39f-46ab-8bb7-2a8430cad2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:54.581959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71a02f-d39f-46ab-8bb7-2a8430cad2ce None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:54.582224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71a02f-d39f-46ab-8bb7-2a8430cad2ce None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:54.582495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71a02f-d39f-46ab-8bb7-2a8430cad2ce None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:54.583730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71a02f-d39f-46ab-8bb7-2a8430cad2ce None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:54.585174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71a02f-d39f-46ab-8bb7-2a8430cad2ce None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:54.586897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 152/293] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:54 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:54.592860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6a692-c067-498d-928a-034bad3b4360 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:54.655213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773a65-eac6-494a-8da3-b118052587b6 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:54.655498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773a65-eac6-494a-8da3-b118052587b6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:54.655930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773a65-eac6-494a-8da3-b118052587b6 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:54.662061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 153/294] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:54.663543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3192e-5284-4650-8cae-40420bc36b4a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:54.664017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3192e-5284-4650-8cae-40420bc36b4a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:54.664477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3192e-5284-4650-8cae-40420bc36b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:54.707261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6a692-c067-498d-928a-034bad3b4360 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:54.710735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-4fc3192e-5284-4650-8cae-40420bc36b4a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:54.711926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4fc3192e-5284-4650-8cae-40420bc36b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:54.751136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:54.751800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:54.752080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:54.752411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:54.753262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] RBAC: Adding query filter params (role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user.id=8101913053b74dd5a330867cf27bc9bf) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:54.753602 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:54.755060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:54.768278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 142/295] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:54 2022] GET /identity/v3/role_assignments?user.id=8101913053b74dd5a330867cf27bc9bf&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:54.814809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 154/296] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:54.838623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:54.947845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3602c-4270-422d-b733-cded4ff843a6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:54.987168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515daa6-ec18-43d7-a284-8739e1ab0b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:54.987914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515daa6-ec18-43d7-a284-8739e1ab0b89 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:54.988195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515daa6-ec18-43d7-a284-8739e1ab0b89 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:54.988470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515daa6-ec18-43d7-a284-8739e1ab0b89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.006038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515daa6-ec18-43d7-a284-8739e1ab0b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-0515daa6-ec18-43d7-a284-8739e1ab0b89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:55.013934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:55.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:55.015983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 143/297] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:55.021774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3192e-5284-4650-8cae-40420bc36b4a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.033642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a69e-ff98-4719-89d5-5bd64484ee71 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.034299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a69e-ff98-4719-89d5-5bd64484ee71 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.034529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881a69e-ff98-4719-89d5-5bd64484ee71 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.036265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 144/298] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:55.043209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bd7e-6051-4159-a074-ff8c6fc71037 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.043501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bd7e-6051-4159-a074-ff8c6fc71037 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.043783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bd7e-6051-4159-a074-ff8c6fc71037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.068743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2026bd7e-6051-4159-a074-ff8c6fc71037 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:55.070896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2026bd7e-6051-4159-a074-ff8c6fc71037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:55.142378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3192e-5284-4650-8cae-40420bc36b4a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.161563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 145/299] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:55.172591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4b09-eb8c-4db2-8b8b-da25dc286a49 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.173068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4b09-eb8c-4db2-8b8b-da25dc286a49 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.173480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f4b09-eb8c-4db2-8b8b-da25dc286a49 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.175315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 146/300] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:24:55.180413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a01ff-b575-45b9-8ba3-15e95ed1a04b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.180859 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a01ff-b575-45b9-8ba3-15e95ed1a04b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.181275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a01ff-b575-45b9-8ba3-15e95ed1a04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.194361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.195287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.195570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.195842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.196586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:55.196892 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:55.198102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-776a01ff-b575-45b9-8ba3-15e95ed1a04b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:55.198315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:55.200510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-776a01ff-b575-45b9-8ba3-15e95ed1a04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:55.207895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 155/301] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:55.208925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.274434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 147/302] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:55.275577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a01ff-b575-45b9-8ba3-15e95ed1a04b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.337166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b88c10-ea09-4180-a9cd-5890cfd0ebfc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.368918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62350a22-b229-4a34-9980-777bba8a4199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.369738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62350a22-b229-4a34-9980-777bba8a4199 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.370018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62350a22-b229-4a34-9980-777bba8a4199 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.370284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62350a22-b229-4a34-9980-777bba8a4199 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.374829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a01ff-b575-45b9-8ba3-15e95ed1a04b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.380282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62350a22-b229-4a34-9980-777bba8a4199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-62350a22-b229-4a34-9980-777bba8a4199 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:55.387982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:55.388862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:55.389684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 156/303] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:55.390888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62350a22-b229-4a34-9980-777bba8a4199 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.412709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2655-2577-4c91-b66b-db9caead800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.413605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2655-2577-4c91-b66b-db9caead800e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.413887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2655-2577-4c91-b66b-db9caead800e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.414155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2655-2577-4c91-b66b-db9caead800e None admin] PATH_INFO: `/v3/users/336716a5b6bd45389c97bc07ad09b59b` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.426961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca2655-2577-4c91-b66b-db9caead800e None admin] RBAC: Authorizing `identity:get_user(user_id=336716a5b6bd45389c97bc07ad09b59b)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:55.428429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca2655-2577-4c91-b66b-db9caead800e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:55.430201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 148/304] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/users/336716a5b6bd45389c97bc07ad09b59b => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:55.431006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2655-2577-4c91-b66b-db9caead800e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.491794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62350a22-b229-4a34-9980-777bba8a4199 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.523102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2655-2577-4c91-b66b-db9caead800e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.523336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eaf0c-a9e9-4069-9b8d-5719d1c07bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.524128 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eaf0c-a9e9-4069-9b8d-5719d1c07bfa None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.524416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eaf0c-a9e9-4069-9b8d-5719d1c07bfa None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.524734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eaf0c-a9e9-4069-9b8d-5719d1c07bfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.525854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92eaf0c-a9e9-4069-9b8d-5719d1c07bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:55.527282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92eaf0c-a9e9-4069-9b8d-5719d1c07bfa None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:55.529158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 157/305] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:55.530331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd402b19-cc80-4b95-9108-c95ba581dd83 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.530612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd402b19-cc80-4b95-9108-c95ba581dd83 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.530882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd402b19-cc80-4b95-9108-c95ba581dd83 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.532356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 158/306] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:55.532910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd402b19-cc80-4b95-9108-c95ba581dd83 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.556435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.557098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.557374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.557675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.558413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] RBAC: Adding query filter params (name=member) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:55.558715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:55.560068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:55.568340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 149/307] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:55.569080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.629195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd402b19-cc80-4b95-9108-c95ba581dd83 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.659933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30189-2551-46cf-bca5-257b50d4f8ef None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.660474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e3b5-cbad-464f-bce0-224d9fd1ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.661116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e3b5-cbad-464f-bce0-224d9fd1ec83 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.661398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e3b5-cbad-464f-bce0-224d9fd1ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.661712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e3b5-cbad-464f-bce0-224d9fd1ec83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.662528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e3b5-cbad-464f-bce0-224d9fd1ec83 None admin] RBAC: Adding query filter params (role.id=5637904dab8642e795bb9ced27c7aae8, user.id=336716a5b6bd45389c97bc07ad09b59b, scope.system=all) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:55.662837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e3b5-cbad-464f-bce0-224d9fd1ec83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:55.664266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e3b5-cbad-464f-bce0-224d9fd1ec83 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:55.669105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 159/308] 10.222.0.36 () {56 vars in 1308 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/role_assignments?user.id=336716a5b6bd45389c97bc07ad09b59b&scope.system=all&role.id=5637904dab8642e795bb9ced27c7aae8 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:55.670300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48de2-6f32-4728-bb02-3cf4f698c3f9 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.670584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48de2-6f32-4728-bb02-3cf4f698c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.670859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48de2-6f32-4728-bb02-3cf4f698c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.688087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-bac48de2-6f32-4728-bb02-3cf4f698c3f9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:55.689344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bac48de2-6f32-4728-bb02-3cf4f698c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:55.712191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0d13-f434-44f5-89fa-582ad3759722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.712869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0d13-f434-44f5-89fa-582ad3759722 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.713161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0d13-f434-44f5-89fa-582ad3759722 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.713432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a0d13-f434-44f5-89fa-582ad3759722 None admin] PATH_INFO: `/v3/groups` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.714196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a0d13-f434-44f5-89fa-582ad3759722 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:55.715720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a0d13-f434-44f5-89fa-582ad3759722 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:55.734171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 150/309] 10.222.0.36 () {60 vars in 1134 bytes} [Wed May 11 07:24:55 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:24:55.735337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0d13-f434-44f5-89fa-582ad3759722 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.777691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 160/310] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:55.801716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48de2-6f32-4728-bb02-3cf4f698c3f9 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.909405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a0d13-f434-44f5-89fa-582ad3759722 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.925948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48de2-6f32-4728-bb02-3cf4f698c3f9 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:55.948748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146928d9-7f4a-4960-a606-b7b9b3ccd687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.949560 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146928d9-7f4a-4960-a606-b7b9b3ccd687 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.950587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146928d9-7f4a-4960-a606-b7b9b3ccd687 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.950587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146928d9-7f4a-4960-a606-b7b9b3ccd687 None admin] PATH_INFO: `/v3/users/276ec86be6234ccabf1003f0a4a47793` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.952947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146928d9-7f4a-4960-a606-b7b9b3ccd687 None admin] RBAC: Authorizing `identity:get_user(user_id=276ec86be6234ccabf1003f0a4a47793)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:55.953703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146928d9-7f4a-4960-a606-b7b9b3ccd687 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:55.960480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 151/311] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/users/276ec86be6234ccabf1003f0a4a47793 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:55.961671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146928d9-7f4a-4960-a606-b7b9b3ccd687 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:55.967249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf4bed-c9ea-4067-b077-a2435d3b236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:55.968300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf4bed-c9ea-4067-b077-a2435d3b236e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:55.968770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf4bed-c9ea-4067-b077-a2435d3b236e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:55.969230 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf4bed-c9ea-4067-b077-a2435d3b236e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:55.981471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf4bed-c9ea-4067-b077-a2435d3b236e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-1daf4bed-c9ea-4067-b077-a2435d3b236e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:55.990622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:55.991469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:24:55.992268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 161/312] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:24:55.996210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf4bed-c9ea-4067-b077-a2435d3b236e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:56.090859 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146928d9-7f4a-4960-a606-b7b9b3ccd687 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:56.097358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf4bed-c9ea-4067-b077-a2435d3b236e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:56.130919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:56.131606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:56.131886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:56.132016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df434e-e429-46c1-b475-7ca6dbd99b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:56.132202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:56.132751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df434e-e429-46c1-b475-7ca6dbd99b0d None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:56.132936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:56.133028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df434e-e429-46c1-b475-7ca6dbd99b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:56.133184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:56.133330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df434e-e429-46c1-b475-7ca6dbd99b0d None admin] PATH_INFO: `/v3/system/users/276ec86be6234ccabf1003f0a4a47793/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:56.134822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df434e-e429-46c1-b475-7ca6dbd99b0d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=276ec86be6234ccabf1003f0a4a47793, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:56.134931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:56.136364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df434e-e429-46c1-b475-7ca6dbd99b0d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:56.145576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 162/313] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:56.151387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:56.154127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 152/314] 10.222.0.36 () {58 vars in 1334 bytes} [Wed May 11 07:24:55 2022] PUT /identity/v3/system/users/276ec86be6234ccabf1003f0a4a47793/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:24:56.271455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124757c-5e77-4dca-9484-10be32818635 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:56.311657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40d9f9-c061-4bf1-ba8a-9eb733c2b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:56.313185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d9f9-c061-4bf1-ba8a-9eb733c2b67d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:56.313810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d9f9-c061-4bf1-ba8a-9eb733c2b67d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:56.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40d9f9-c061-4bf1-ba8a-9eb733c2b67d None admin] PATH_INFO: `/v3/users/efe17de7006b460891f711e2f7f3ed24` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:56.315891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40d9f9-c061-4bf1-ba8a-9eb733c2b67d None admin] RBAC: Authorizing `identity:get_user(user_id=efe17de7006b460891f711e2f7f3ed24)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:56.317653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40d9f9-c061-4bf1-ba8a-9eb733c2b67d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:56.320049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 163/315] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:56 2022] GET /identity/v3/users/efe17de7006b460891f711e2f7f3ed24 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:56.325828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df434e-e429-46c1-b475-7ca6dbd99b0d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:56.427967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df434e-e429-46c1-b475-7ca6dbd99b0d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:56.461989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b1e4-e12a-413a-a73d-636d8098f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:56.462639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b1e4-e12a-413a-a73d-636d8098f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:56.462922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b1e4-e12a-413a-a73d-636d8098f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:56.463202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b1e4-e12a-413a-a73d-636d8098f0a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:56.530299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8b1e4-e12a-413a-a73d-636d8098f0a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:56.531757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8b1e4-e12a-413a-a73d-636d8098f0a7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:56.635195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 153/316] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:24:56.641616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40d9f9-c061-4bf1-ba8a-9eb733c2b67d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:56.740216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40d9f9-c061-4bf1-ba8a-9eb733c2b67d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:56.773354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce18d16-1e45-4cc3-9525-f2e4848927ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:56.774248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce18d16-1e45-4cc3-9525-f2e4848927ba None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:56.774527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce18d16-1e45-4cc3-9525-f2e4848927ba None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:56.774802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce18d16-1e45-4cc3-9525-f2e4848927ba None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:56.775970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce18d16-1e45-4cc3-9525-f2e4848927ba None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:56.777414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce18d16-1e45-4cc3-9525-f2e4848927ba None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:56.779427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 164/317] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:24:56 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:56.785211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b1e4-e12a-413a-a73d-636d8098f0a7 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:56.886577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b1e4-e12a-413a-a73d-636d8098f0a7 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:56.920690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c88368-7240-4902-a996-b01948f9d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:56.921345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c88368-7240-4902-a996-b01948f9d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:56.921659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c88368-7240-4902-a996-b01948f9d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:56.921936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c88368-7240-4902-a996-b01948f9d3c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:56.922762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c88368-7240-4902-a996-b01948f9d3c2 None admin] RBAC: Adding query filter params (role.id=5637904dab8642e795bb9ced27c7aae8, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf, user.id=efe17de7006b460891f711e2f7f3ed24) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:56.923075 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c88368-7240-4902-a996-b01948f9d3c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:56.924573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c88368-7240-4902-a996-b01948f9d3c2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:56.931455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 154/318] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:24:56 2022] GET /identity/v3/role_assignments?user.id=efe17de7006b460891f711e2f7f3ed24&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=5637904dab8642e795bb9ced27c7aae8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:57.985063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b132dbb-07d6-4b54-a686-5e0af7541926 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:57.985785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b132dbb-07d6-4b54-a686-5e0af7541926 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:57.985785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b132dbb-07d6-4b54-a686-5e0af7541926 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:57.987183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 165/319] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:57.992119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e36a2-8a5e-4a94-94da-e3b47ec4908e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:57.992508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e36a2-8a5e-4a94-94da-e3b47ec4908e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:57.992683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e36a2-8a5e-4a94-94da-e3b47ec4908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.009002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-982e36a2-8a5e-4a94-94da-e3b47ec4908e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:58.010222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-982e36a2-8a5e-4a94-94da-e3b47ec4908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:58.037787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf80f-f1ed-4e77-9eaa-141db15e0484 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.038172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf80f-f1ed-4e77-9eaa-141db15e0484 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.038514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf80f-f1ed-4e77-9eaa-141db15e0484 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.039960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 166/320] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:58.044973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20529979-6c2e-4939-a251-a8ee406f39a4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.045336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20529979-6c2e-4939-a251-a8ee406f39a4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.045642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20529979-6c2e-4939-a251-a8ee406f39a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.061672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-20529979-6c2e-4939-a251-a8ee406f39a4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:58.063118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-20529979-6c2e-4939-a251-a8ee406f39a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:58.077941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 155/321] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:24:58.101116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e36a2-8a5e-4a94-94da-e3b47ec4908e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:58.127209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 167/322] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:58.149739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20529979-6c2e-4939-a251-a8ee406f39a4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:58.197619 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e36a2-8a5e-4a94-94da-e3b47ec4908e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:58.231581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeb14a-74b6-4e43-a08e-2e7696a58e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:58.232461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb14a-74b6-4e43-a08e-2e7696a58e71 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.232751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb14a-74b6-4e43-a08e-2e7696a58e71 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.232999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb14a-74b6-4e43-a08e-2e7696a58e71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.243290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdeb14a-74b6-4e43-a08e-2e7696a58e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:58.249234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20529979-6c2e-4939-a251-a8ee406f39a4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-9bdeb14a-74b6-4e43-a08e-2e7696a58e71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:58.251212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:58.252048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:58.258950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 156/323] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:58.259594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeb14a-74b6-4e43-a08e-2e7696a58e71 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:58.288335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa369c1-0f63-4555-8403-bb56ce7d3878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:58.289830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa369c1-0f63-4555-8403-bb56ce7d3878 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.290418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa369c1-0f63-4555-8403-bb56ce7d3878 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.291180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa369c1-0f63-4555-8403-bb56ce7d3878 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.292794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa369c1-0f63-4555-8403-bb56ce7d3878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:58.295437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa369c1-0f63-4555-8403-bb56ce7d3878 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:58.297659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 168/324] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:58.302913 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa369c1-0f63-4555-8403-bb56ce7d3878 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:58.361443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeb14a-74b6-4e43-a08e-2e7696a58e71 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:58.397646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:58.398311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.398594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.398992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.399597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:58.399900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:58.401265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:58.401661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa369c1-0f63-4555-8403-bb56ce7d3878 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:58.409447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 157/325] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:58.414658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:58.435072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b071b69-84db-46d8-b467-606d86e9e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:58.435735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b071b69-84db-46d8-b467-606d86e9e1ec None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.436012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b071b69-84db-46d8-b467-606d86e9e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.436282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b071b69-84db-46d8-b467-606d86e9e1ec None admin] PATH_INFO: `/v3/groups` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.437202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b071b69-84db-46d8-b467-606d86e9e1ec None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:58.438810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b071b69-84db-46d8-b467-606d86e9e1ec None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:58.461566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 169/326] 10.222.0.36 () {60 vars in 1134 bytes} [Wed May 11 07:24:58 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:24:58.461566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66ceb-92f2-4d5c-b2b4-5b9ca05dffdd None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.461566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66ceb-92f2-4d5c-b2b4-5b9ca05dffdd None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.461566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66ceb-92f2-4d5c-b2b4-5b9ca05dffdd None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.461566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 170/327] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:24:58.463558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e441dc-95d8-465b-8cf1-0b8f8c4aebbb None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.464220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e441dc-95d8-465b-8cf1-0b8f8c4aebbb None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.464220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e441dc-95d8-465b-8cf1-0b8f8c4aebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.488345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-57e441dc-95d8-465b-8cf1-0b8f8c4aebbb None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:24:58.489591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-57e441dc-95d8-465b-8cf1-0b8f8c4aebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:24:58.519809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7889ea-c18f-4714-87b0-f0bdaf147500 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:58.553420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad50e5-41f5-4447-ad83-fbc9759a693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:58.554369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad50e5-41f5-4447-ad83-fbc9759a693e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.554655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad50e5-41f5-4447-ad83-fbc9759a693e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.554930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad50e5-41f5-4447-ad83-fbc9759a693e None admin] PATH_INFO: `/v3/users/336716a5b6bd45389c97bc07ad09b59b` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.556247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad50e5-41f5-4447-ad83-fbc9759a693e None admin] RBAC: Authorizing `identity:get_user(user_id=336716a5b6bd45389c97bc07ad09b59b)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:58.557742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad50e5-41f5-4447-ad83-fbc9759a693e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:58.563907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 171/328] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:24:58.564080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 158/329] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:58 2022] GET /identity/v3/users/336716a5b6bd45389c97bc07ad09b59b => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:58.569561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e441dc-95d8-465b-8cf1-0b8f8c4aebbb None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:58.583927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad50e5-41f5-4447-ad83-fbc9759a693e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:58.667913 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e441dc-95d8-465b-8cf1-0b8f8c4aebbb None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:58.691949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad50e5-41f5-4447-ad83-fbc9759a693e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:58.709210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189cd1d-3454-4152-8778-44b116120e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:58.710875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189cd1d-3454-4152-8778-44b116120e1b None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.710875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189cd1d-3454-4152-8778-44b116120e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.710875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189cd1d-3454-4152-8778-44b116120e1b None admin] PATH_INFO: `/v3/system/users/336716a5b6bd45389c97bc07ad09b59b/roles/5637904dab8642e795bb9ced27c7aae8` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.713966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189cd1d-3454-4152-8778-44b116120e1b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=336716a5b6bd45389c97bc07ad09b59b, role_id=5637904dab8642e795bb9ced27c7aae8)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:58.715772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189cd1d-3454-4152-8778-44b116120e1b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:58.728829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cb512-0baf-4772-bf64-70d77035746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:58.729857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 172/330] 10.222.0.36 () {58 vars in 1334 bytes} [Wed May 11 07:24:58 2022] PUT /identity/v3/system/users/336716a5b6bd45389c97bc07ad09b59b/roles/5637904dab8642e795bb9ced27c7aae8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:24:58.730062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cb512-0baf-4772-bf64-70d77035746b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.730489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cb512-0baf-4772-bf64-70d77035746b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.730867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cb512-0baf-4772-bf64-70d77035746b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.746291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559cb512-0baf-4772-bf64-70d77035746b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-559cb512-0baf-4772-bf64-70d77035746b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:24:58.755957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:24:58.757126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:24:58.758175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:24:58.759204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 159/331] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:24:58.765396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189cd1d-3454-4152-8778-44b116120e1b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:58.878253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189cd1d-3454-4152-8778-44b116120e1b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:58.914707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:58.915384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:58.915661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:58.915979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:58.916680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:58.917026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:58.918398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:58.928137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 173/332] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:24:58.934038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cb512-0baf-4772-bf64-70d77035746b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:59.037100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cb512-0baf-4772-bf64-70d77035746b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:59.071662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe052c-d8b7-4058-b7d3-7a9a3852ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:59.072547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe052c-d8b7-4058-b7d3-7a9a3852ec94 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:59.072825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe052c-d8b7-4058-b7d3-7a9a3852ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:59.073097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe052c-d8b7-4058-b7d3-7a9a3852ec94 None admin] PATH_INFO: `/v3/users/276ec86be6234ccabf1003f0a4a47793` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:59.074332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe052c-d8b7-4058-b7d3-7a9a3852ec94 None admin] RBAC: Authorizing `identity:get_user(user_id=276ec86be6234ccabf1003f0a4a47793)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:59.075782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe052c-d8b7-4058-b7d3-7a9a3852ec94 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:59.077847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 160/333] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:24:58 2022] GET /identity/v3/users/276ec86be6234ccabf1003f0a4a47793 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:24:59.083821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:24:59.186664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c945e3-bf34-4d3b-8534-7dd80993321e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:24:59.219899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502da694-260f-442d-94b1-f79c87e13083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:24:59.220609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da694-260f-442d-94b1-f79c87e13083 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:24:59.220886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da694-260f-442d-94b1-f79c87e13083 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:24:59.221747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da694-260f-442d-94b1-f79c87e13083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:24:59.222580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da694-260f-442d-94b1-f79c87e13083 None admin] RBAC: Adding query filter params (role.id=e6b936a5820f443fb9310f7cdfe7a1f6, user.id=276ec86be6234ccabf1003f0a4a47793, scope.system=all) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:24:59.222889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da694-260f-442d-94b1-f79c87e13083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:24:59.224326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da694-260f-442d-94b1-f79c87e13083 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:24:59.236438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 174/334] 10.222.0.36 () {56 vars in 1308 bytes} [Wed May 11 07:24:59 2022] GET /identity/v3/role_assignments?user.id=276ec86be6234ccabf1003f0a4a47793&scope.system=all&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 510 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:00.971607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f155439-c731-4dac-baff-f23c32009ef0 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:00.972142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f155439-c731-4dac-baff-f23c32009ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:00.972142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f155439-c731-4dac-baff-f23c32009ef0 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:00.973769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 161/335] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:00.979250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc990af-1759-423b-9ca4-86a8e3806f75 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:00.979644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc990af-1759-423b-9ca4-86a8e3806f75 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:00.979824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc990af-1759-423b-9ca4-86a8e3806f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:00.997585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6cc990af-1759-423b-9ca4-86a8e3806f75 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:00.998780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6cc990af-1759-423b-9ca4-86a8e3806f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:01.073362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 175/336] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:01.120699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f155439-c731-4dac-baff-f23c32009ef0 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:01.241406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f155439-c731-4dac-baff-f23c32009ef0 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:01.280702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2488bf8-28e8-4fe0-9ba4-1d304dfbfb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:01.281512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488bf8-28e8-4fe0-9ba4-1d304dfbfb31 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:01.281816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488bf8-28e8-4fe0-9ba4-1d304dfbfb31 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:01.282088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2488bf8-28e8-4fe0-9ba4-1d304dfbfb31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:01.298747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2488bf8-28e8-4fe0-9ba4-1d304dfbfb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-d2488bf8-28e8-4fe0-9ba4-1d304dfbfb31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:01.306589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:01.307430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:01.308631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 162/337] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:01.314040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc990af-1759-423b-9ca4-86a8e3806f75 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:01.409928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3310-a5ef-41ca-90e0-9908563a21ce None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:01.410504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3310-a5ef-41ca-90e0-9908563a21ce None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:01.410780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3310-a5ef-41ca-90e0-9908563a21ce None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:01.412924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 163/338] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:01.420757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741e80f-287d-4ad4-a7d3-5b4e24c12bc7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:01.420757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741e80f-287d-4ad4-a7d3-5b4e24c12bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:01.420757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741e80f-287d-4ad4-a7d3-5b4e24c12bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:01.428493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc990af-1759-423b-9ca4-86a8e3806f75 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:01.440658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a741e80f-287d-4ad4-a7d3-5b4e24c12bc7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:01.442162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a741e80f-287d-4ad4-a7d3-5b4e24c12bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:01.507794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:01.508403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:01.508686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:01.508964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:01.509748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:01.510061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:01.511443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:01.528685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 164/339] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:01.530616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 176/340] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:01.536314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741e80f-287d-4ad4-a7d3-5b4e24c12bc7 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:01.551689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:01.662727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741e80f-287d-4ad4-a7d3-5b4e24c12bc7 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:01.699410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5dc6a-8014-4163-a36b-c44451e295ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:01.700420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5dc6a-8014-4163-a36b-c44451e295ab None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:01.700915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5dc6a-8014-4163-a36b-c44451e295ab None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:01.701397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5dc6a-8014-4163-a36b-c44451e295ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:01.776456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5dc6a-8014-4163-a36b-c44451e295ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:01.778299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5dc6a-8014-4163-a36b-c44451e295ab None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:01.791853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b1674-1cfe-4cf0-92d3-bf91b77bbedc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:01.888058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 165/341] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:25:01.890158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5dc6a-8014-4163-a36b-c44451e295ab None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:01.894477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a92e78-c91b-4a3b-a616-46af839376ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:01.895314 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a92e78-c91b-4a3b-a616-46af839376ad None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:01.895604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a92e78-c91b-4a3b-a616-46af839376ad None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:01.895920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a92e78-c91b-4a3b-a616-46af839376ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:01.926629 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a92e78-c91b-4a3b-a616-46af839376ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-02a92e78-c91b-4a3b-a616-46af839376ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:01.935116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:01.936069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:01.937306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 177/342] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:01.943196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a92e78-c91b-4a3b-a616-46af839376ad None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:01.996946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5dc6a-8014-4163-a36b-c44451e295ab None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.030858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaedd7a-3a5e-4862-aa10-86b915e454a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.031933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaedd7a-3a5e-4862-aa10-86b915e454a1 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.032353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaedd7a-3a5e-4862-aa10-86b915e454a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.032780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaedd7a-3a5e-4862-aa10-86b915e454a1 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.034654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaedd7a-3a5e-4862-aa10-86b915e454a1 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:02.036244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaedd7a-3a5e-4862-aa10-86b915e454a1 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:02.038102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 166/343] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:01 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:02.043584 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaedd7a-3a5e-4862-aa10-86b915e454a1 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:02.082105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a92e78-c91b-4a3b-a616-46af839376ad None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.121087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663187fa-0eba-488b-ac20-3a3e47a154dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.122004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663187fa-0eba-488b-ac20-3a3e47a154dd None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.122123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663187fa-0eba-488b-ac20-3a3e47a154dd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.122333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663187fa-0eba-488b-ac20-3a3e47a154dd None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.123088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663187fa-0eba-488b-ac20-3a3e47a154dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:02.123396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663187fa-0eba-488b-ac20-3a3e47a154dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:02.124777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663187fa-0eba-488b-ac20-3a3e47a154dd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:02.133957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 178/344] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:02.135277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d6567-ff94-4670-a40e-9a85c80a30c7 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.135566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d6567-ff94-4670-a40e-9a85c80a30c7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.135843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d6567-ff94-4670-a40e-9a85c80a30c7 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.141573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 179/345] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:02.142381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d6567-ff94-4670-a40e-9a85c80a30c7 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:02.147293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaedd7a-3a5e-4862-aa10-86b915e454a1 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.182881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f867e8-85f1-46cc-9ba3-ad607b52dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.184032 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f867e8-85f1-46cc-9ba3-ad607b52dde9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.184454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f867e8-85f1-46cc-9ba3-ad607b52dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.184955 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f867e8-85f1-46cc-9ba3-ad607b52dde9 None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.192775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f867e8-85f1-46cc-9ba3-ad607b52dde9 None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:02.194669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f867e8-85f1-46cc-9ba3-ad607b52dde9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:02.196731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 167/346] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:02.204007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1234-a4de-46c6-b865-c5f894896662 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.204806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1234-a4de-46c6-b865-c5f894896662 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.205533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1234-a4de-46c6-b865-c5f894896662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.228027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8f6c1234-a4de-46c6-b865-c5f894896662 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:02.229468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8f6c1234-a4de-46c6-b865-c5f894896662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:02.276360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d6567-ff94-4670-a40e-9a85c80a30c7 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.310997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 168/347] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:02.313449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1234-a4de-46c6-b865-c5f894896662 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:02.314751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1504f1-7a68-4bf7-941c-8995aca00d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.315497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1504f1-7a68-4bf7-941c-8995aca00d39 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.315852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1504f1-7a68-4bf7-941c-8995aca00d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.316196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1504f1-7a68-4bf7-941c-8995aca00d39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.384691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1504f1-7a68-4bf7-941c-8995aca00d39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:02.386295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1504f1-7a68-4bf7-941c-8995aca00d39 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:02.416307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1234-a4de-46c6-b865-c5f894896662 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.454839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.456333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.456757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.457188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.458189 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] RBAC: Adding query filter params (group.id=e3f5781c481b4e64a4c088ba7e12f7bc, role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=52ce4f52f95b46479b0949667e03c0d3) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:02.458636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:02.460231 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:02.466147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 169/348] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/role_assignments?group.id=e3f5781c481b4e64a4c088ba7e12f7bc&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:02.467317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:02.487043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 180/349] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:02.492666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1504f1-7a68-4bf7-941c-8995aca00d39 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:02.576551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbdbdc-a2a1-491d-b2e8-f3fb41a3c0fb None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.604476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1504f1-7a68-4bf7-941c-8995aca00d39 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.612443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3d1f9-0606-492e-98c3-cad4124277a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.613562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d1f9-0606-492e-98c3-cad4124277a0 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.614036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d1f9-0606-492e-98c3-cad4124277a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.614484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d1f9-0606-492e-98c3-cad4124277a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.626715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3d1f9-0606-492e-98c3-cad4124277a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-67a3d1f9-0606-492e-98c3-cad4124277a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:02.634951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:02.635858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 07:25:02.636671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:02.639036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 170/350] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:02.640950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e88a1e-9c6a-4f89-a56e-4f973bdf2bf3 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.641301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae411-c402-4ef6-8790-4458fbc8af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.641555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e88a1e-9c6a-4f89-a56e-4f973bdf2bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.641967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e88a1e-9c6a-4f89-a56e-4f973bdf2bf3 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.642471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae411-c402-4ef6-8790-4458fbc8af1d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.643372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae411-c402-4ef6-8790-4458fbc8af1d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.643738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae411-c402-4ef6-8790-4458fbc8af1d None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.644799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 171/351] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:02.645323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae411-c402-4ef6-8790-4458fbc8af1d None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:02.648239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae411-c402-4ef6-8790-4458fbc8af1d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:02.648675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e88a1e-9c6a-4f89-a56e-4f973bdf2bf3 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:02.648925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 181/352] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:02.654496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee8a1f-ecb6-41cb-9fee-765098570a3e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.654931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee8a1f-ecb6-41cb-9fee-765098570a3e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.655313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee8a1f-ecb6-41cb-9fee-765098570a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.677695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-3cee8a1f-ecb6-41cb-9fee-765098570a3e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:02.679102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3cee8a1f-ecb6-41cb-9fee-765098570a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:02.760850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e88a1e-9c6a-4f89-a56e-4f973bdf2bf3 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.795090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.796025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.796446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.796856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.797763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] RBAC: Adding query filter params (name=reader) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:02.798222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:02.799777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:02.809673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 172/353] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:02.810773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:02.837504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 182/354] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:02.838413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee8a1f-ecb6-41cb-9fee-765098570a3e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:02.911992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd91705-f07f-4017-97eb-b740e9ecdcfd None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:02.946480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1962d-e3c0-4f52-9f0b-4a566addf9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:02.947572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1962d-e3c0-4f52-9f0b-4a566addf9d7 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:02.947987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1962d-e3c0-4f52-9f0b-4a566addf9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:02.948391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1962d-e3c0-4f52-9f0b-4a566addf9d7 None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:02.949757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1962d-e3c0-4f52-9f0b-4a566addf9d7 None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:02.951337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1962d-e3c0-4f52-9f0b-4a566addf9d7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:02.953451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 173/355] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:02.954498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1962d-e3c0-4f52-9f0b-4a566addf9d7 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:03.040668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee8a1f-ecb6-41cb-9fee-765098570a3e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:03.055168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1962d-e3c0-4f52-9f0b-4a566addf9d7 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:03.091529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0ef2c-8f70-4e68-b337-06817e059a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:03.092540 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0ef2c-8f70-4e68-b337-06817e059a61 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.092959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0ef2c-8f70-4e68-b337-06817e059a61 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.093367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0ef2c-8f70-4e68-b337-06817e059a61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.103900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0ef2c-8f70-4e68-b337-06817e059a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:03.112537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabddd0-f2cc-47e0-9728-b9c67e1c6cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-fcd0ef2c-8f70-4e68-b337-06817e059a61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:03.113246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:03.114306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:03.115235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:03.115959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabddd0-f2cc-47e0-9728-b9c67e1c6cf8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.115959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabddd0-f2cc-47e0-9728-b9c67e1c6cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.115959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabddd0-f2cc-47e0-9728-b9c67e1c6cf8 None admin] PATH_INFO: `/v3/users/336716a5b6bd45389c97bc07ad09b59b` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.117716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabddd0-f2cc-47e0-9728-b9c67e1c6cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=336716a5b6bd45389c97bc07ad09b59b)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:03.117884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 174/356] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:03.118790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0ef2c-8f70-4e68-b337-06817e059a61 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:03.119158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabddd0-f2cc-47e0-9728-b9c67e1c6cf8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:03.121141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 183/357] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:25:02 2022] GET /identity/v3/users/336716a5b6bd45389c97bc07ad09b59b => generated 293 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:03.126802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabddd0-f2cc-47e0-9728-b9c67e1c6cf8 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:03.223036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0ef2c-8f70-4e68-b337-06817e059a61 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:03.257634 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:03.258532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.258951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.259360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.260382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] RBAC: Adding query filter params (group.id=e3f5781c481b4e64a4c088ba7e12f7bc, role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=52ce4f52f95b46479b0949667e03c0d3) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:03.260857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:03.262461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:03.268616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 175/358] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:03 2022] GET /identity/v3/role_assignments?group.id=e3f5781c481b4e64a4c088ba7e12f7bc&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=aa78a08951eb49f78aeda141988844de => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:03.269693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:03.331886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabddd0-f2cc-47e0-9728-b9c67e1c6cf8 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:03.374534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f445e4e-5db4-4d9e-ae01-fb8f0cc5b5f5 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:03.413282 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:03.414286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.414708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.415121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.416126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] RBAC: Adding query filter params (role.id=5637904dab8642e795bb9ced27c7aae8, user.id=336716a5b6bd45389c97bc07ad09b59b, scope.system=all) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:03.416576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:03.418190 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:03.426286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1afe1-1274-4a22-b56d-dc50816f1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:03.426979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1afe1-1274-4a22-b56d-dc50816f1f4f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.427261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1afe1-1274-4a22-b56d-dc50816f1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.427535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1afe1-1274-4a22-b56d-dc50816f1f4f None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.428296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1afe1-1274-4a22-b56d-dc50816f1f4f None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:03.428604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1afe1-1274-4a22-b56d-dc50816f1f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:03.430040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1afe1-1274-4a22-b56d-dc50816f1f4f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:03.433025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 176/359] 10.222.0.36 () {56 vars in 1308 bytes} [Wed May 11 07:25:03 2022] GET /identity/v3/role_assignments?user.id=336716a5b6bd45389c97bc07ad09b59b&scope.system=all&role.id=5637904dab8642e795bb9ced27c7aae8 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:03.443094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 184/360] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:03.449171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:03.572072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fefbd-9442-431c-a2e6-08abcc247c6d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:03.608712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e3185-83a7-4719-b1dd-2e8e770c4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:03.609374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3185-83a7-4719-b1dd-2e8e770c4736 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.609687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3185-83a7-4719-b1dd-2e8e770c4736 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.609959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3185-83a7-4719-b1dd-2e8e770c4736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.631764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc0508-de2f-4d72-9d30-40b41df30fe5 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.632045 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc0508-de2f-4d72-9d30-40b41df30fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.632234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc0508-de2f-4d72-9d30-40b41df30fe5 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.633957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 185/361] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:03.639544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633278-fe62-4126-bb08-490d808e2eb9 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.639825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633278-fe62-4126-bb08-490d808e2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.640103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633278-fe62-4126-bb08-490d808e2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.677138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-60633278-fe62-4126-bb08-490d808e2eb9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:03.678712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-60633278-fe62-4126-bb08-490d808e2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:03.684963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e3185-83a7-4719-b1dd-2e8e770c4736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:03.686539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e3185-83a7-4719-b1dd-2e8e770c4736 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:03.789433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 177/362] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:03.795863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e3185-83a7-4719-b1dd-2e8e770c4736 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:03.837188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 186/363] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:03.878069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60633278-fe62-4126-bb08-490d808e2eb9 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:03.910685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e3185-83a7-4719-b1dd-2e8e770c4736 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:03.949018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59e0b5-c22a-4676-9f91-6da2c7ed5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:03.949901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59e0b5-c22a-4676-9f91-6da2c7ed5c2c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:03.950178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59e0b5-c22a-4676-9f91-6da2c7ed5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:03.950446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59e0b5-c22a-4676-9f91-6da2c7ed5c2c None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:03.952983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59e0b5-c22a-4676-9f91-6da2c7ed5c2c None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:03.954882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59e0b5-c22a-4676-9f91-6da2c7ed5c2c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:03.957688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 178/364] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:03 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:03.964302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59e0b5-c22a-4676-9f91-6da2c7ed5c2c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:04.073031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59e0b5-c22a-4676-9f91-6da2c7ed5c2c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:04.111368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ac72c-218c-4db2-a19b-3a7744c60c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:04.112015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60633278-fe62-4126-bb08-490d808e2eb9 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:04.112268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ac72c-218c-4db2-a19b-3a7744c60c7a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.112548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ac72c-218c-4db2-a19b-3a7744c60c7a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.112820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ac72c-218c-4db2-a19b-3a7744c60c7a None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.114148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ac72c-218c-4db2-a19b-3a7744c60c7a None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:04.116434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ac72c-218c-4db2-a19b-3a7744c60c7a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:04.118437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 179/365] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:03 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:04.119712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953694bd-aa3e-4c28-b66d-d6e8a7475adf None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.119996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953694bd-aa3e-4c28-b66d-d6e8a7475adf None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.120268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953694bd-aa3e-4c28-b66d-d6e8a7475adf None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.121775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 180/366] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:04.128209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe397eb-3ade-4b12-9cd6-de0c57eca231 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.128488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe397eb-3ade-4b12-9cd6-de0c57eca231 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.128762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe397eb-3ade-4b12-9cd6-de0c57eca231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.147407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5fe397eb-3ade-4b12-9cd6-de0c57eca231 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:04.148604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5fe397eb-3ade-4b12-9cd6-de0c57eca231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:04.179722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d923a-ee06-4c8b-b65b-81e2182860dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:04.180464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d923a-ee06-4c8b-b65b-81e2182860dc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.181759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d923a-ee06-4c8b-b65b-81e2182860dc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.182047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d923a-ee06-4c8b-b65b-81e2182860dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.193712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d923a-ee06-4c8b-b65b-81e2182860dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-de5d923a-ee06-4c8b-b65b-81e2182860dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:04.202090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:04.204162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 187/367] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:04.206687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d923a-ee06-4c8b-b65b-81e2182860dc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:04.223152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 181/368] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:04.224157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe397eb-3ade-4b12-9cd6-de0c57eca231 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:04.339680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d923a-ee06-4c8b-b65b-81e2182860dc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:04.346176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe397eb-3ade-4b12-9cd6-de0c57eca231 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:04.375604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:04.376489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.376608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.376792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.378216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] RBAC: Adding query filter params (group.id=e3f5781c481b4e64a4c088ba7e12f7bc, role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:04.378561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:04.379964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:04.390438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 188/369] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:04 2022] GET /identity/v3/role_assignments?group.id=e3f5781c481b4e64a4c088ba7e12f7bc&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:04.391274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:04.392367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:04.393680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.393966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.394238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.395239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:04.396482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:04.397951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:04.412576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 182/370] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:04.418104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:04.563213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb9fa4-7317-4aaf-bb30-001f4112cb75 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:04.604990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35c72-3aa0-4fc3-817a-3a4b3fb5c300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:04.605862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35c72-3aa0-4fc3-817a-3a4b3fb5c300 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.606141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35c72-3aa0-4fc3-817a-3a4b3fb5c300 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.606414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de35c72-3aa0-4fc3-817a-3a4b3fb5c300 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.620893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de35c72-3aa0-4fc3-817a-3a4b3fb5c300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-5de35c72-3aa0-4fc3-817a-3a4b3fb5c300 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:04.629236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:04.630500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:04.631489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:04.633782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 189/371] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:04.646555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35c72-3aa0-4fc3-817a-3a4b3fb5c300 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:04.650165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f553f-62aa-4b8c-94a2-43a90a4d5ebc None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:04.684997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30070f-94dc-4ab1-9e22-92c75b15b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:04.685947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30070f-94dc-4ab1-9e22-92c75b15b026 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.686419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30070f-94dc-4ab1-9e22-92c75b15b026 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.686845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30070f-94dc-4ab1-9e22-92c75b15b026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.759803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30070f-94dc-4ab1-9e22-92c75b15b026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:04.761489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30070f-94dc-4ab1-9e22-92c75b15b026 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:04.776774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de35c72-3aa0-4fc3-817a-3a4b3fb5c300 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:04.828520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:04.829205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:04.829462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:04.829760 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:04.831086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:04.831086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:04.832205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:04.844705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 190/372] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:04.863435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:04.867058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 183/373] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:25:04.873388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30070f-94dc-4ab1-9e22-92c75b15b026 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:04.972586 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30070f-94dc-4ab1-9e22-92c75b15b026 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:05.001566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2500-96f7-4a09-b352-1dbd200c30e4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:05.020702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6d434-192c-43d9-a530-05002063d9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:05.021489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d434-192c-43d9-a530-05002063d9ac None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:05.021786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d434-192c-43d9-a530-05002063d9ac None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:05.022052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d434-192c-43d9-a530-05002063d9ac None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:05.023950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6d434-192c-43d9-a530-05002063d9ac None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:05.025389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6d434-192c-43d9-a530-05002063d9ac None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:05.027108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 184/374] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:04 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:05.034477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6d434-192c-43d9-a530-05002063d9ac None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:05.066165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6900-7f0e-4e75-87af-3a774f9a33cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:05.066827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6900-7f0e-4e75-87af-3a774f9a33cc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:05.067105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6900-7f0e-4e75-87af-3a774f9a33cc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:05.067373 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e6900-7f0e-4e75-87af-3a774f9a33cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:05.165777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e6900-7f0e-4e75-87af-3a774f9a33cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:05.167672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e6900-7f0e-4e75-87af-3a774f9a33cc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:05.183858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6d434-192c-43d9-a530-05002063d9ac None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:05.234069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91dbf6-4fb9-4845-8c90-997a1b0b57f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:05.234926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91dbf6-4fb9-4845-8c90-997a1b0b57f9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:05.235252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91dbf6-4fb9-4845-8c90-997a1b0b57f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:05.235525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91dbf6-4fb9-4845-8c90-997a1b0b57f9 None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:05.237252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91dbf6-4fb9-4845-8c90-997a1b0b57f9 None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:05.238780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91dbf6-4fb9-4845-8c90-997a1b0b57f9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:05.245655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 185/375] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:05 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:05.247608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91dbf6-4fb9-4845-8c90-997a1b0b57f9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:05.272845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 191/376] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:25:05.277968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6900-7f0e-4e75-87af-3a774f9a33cc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:05.358387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91dbf6-4fb9-4845-8c90-997a1b0b57f9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:05.400913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:05.401599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:05.401884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:05.402170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:05.402996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] RBAC: Adding query filter params (group.id=e3f5781c481b4e64a4c088ba7e12f7bc, role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:05.403308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:05.404742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:05.412356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e6900-7f0e-4e75-87af-3a774f9a33cc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:05.415497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 186/377] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:05 2022] GET /identity/v3/role_assignments?group.id=e3f5781c481b4e64a4c088ba7e12f7bc&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=aa78a08951eb49f78aeda141988844de => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:05.448624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96f50-bd9e-45c3-9f9d-4e2a8bf9807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:05.450002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96f50-bd9e-45c3-9f9d-4e2a8bf9807b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:05.450560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96f50-bd9e-45c3-9f9d-4e2a8bf9807b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:05.451068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96f50-bd9e-45c3-9f9d-4e2a8bf9807b None admin] PATH_INFO: `/v3/projects/5da8d434269248bf956fab772dd66ddd` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:05.452654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc96f50-bd9e-45c3-9f9d-4e2a8bf9807b None admin] RBAC: Authorizing `identity:get_project(project_id=5da8d434269248bf956fab772dd66ddd)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:05.454391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc96f50-bd9e-45c3-9f9d-4e2a8bf9807b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:05.457195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 192/378] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:05 2022] GET /identity/v3/projects/5da8d434269248bf956fab772dd66ddd => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:05.462342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:05.600256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa87ce-5128-4693-a469-70c0288edbc2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:05.640339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596ca44-ddaa-4bb4-a2fe-194852da4de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:05.641198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596ca44-ddaa-4bb4-a2fe-194852da4de0 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:05.641484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596ca44-ddaa-4bb4-a2fe-194852da4de0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:05.641771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596ca44-ddaa-4bb4-a2fe-194852da4de0 None admin] PATH_INFO: `/v3/groups/2f14c35bcf1e4e35a267ff0be957894a` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:05.649856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596ca44-ddaa-4bb4-a2fe-194852da4de0 None admin] RBAC: Authorizing `identity:get_group(group_id=2f14c35bcf1e4e35a267ff0be957894a)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:05.652138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596ca44-ddaa-4bb4-a2fe-194852da4de0 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:05.655230 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 187/379] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:05 2022] GET /identity/v3/groups/2f14c35bcf1e4e35a267ff0be957894a => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:05.661352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96f50-bd9e-45c3-9f9d-4e2a8bf9807b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:05.804955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96f50-bd9e-45c3-9f9d-4e2a8bf9807b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:05.839656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ca7b2-d5fd-4f18-ae83-9e9f2740662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:05.840318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ca7b2-d5fd-4f18-ae83-9e9f2740662d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:05.840597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ca7b2-d5fd-4f18-ae83-9e9f2740662d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:05.840874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ca7b2-d5fd-4f18-ae83-9e9f2740662d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:05.841721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ca7b2-d5fd-4f18-ae83-9e9f2740662d None admin] RBAC: Adding query filter params (group.id=2f14c35bcf1e4e35a267ff0be957894a, role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=5da8d434269248bf956fab772dd66ddd) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:05.842036 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ca7b2-d5fd-4f18-ae83-9e9f2740662d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:05.843459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ca7b2-d5fd-4f18-ae83-9e9f2740662d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:05.849487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 193/380] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:05 2022] GET /identity/v3/role_assignments?group.id=2f14c35bcf1e4e35a267ff0be957894a&scope.project.id=5da8d434269248bf956fab772dd66ddd&role.id=de114c58fdc8476ebab657e6f9359155 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:06.211328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d7c7-db01-4110-b9e6-dc307bc6388e None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:06.212390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d7c7-db01-4110-b9e6-dc307bc6388e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:06.212889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d7c7-db01-4110-b9e6-dc307bc6388e None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:06.214780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 188/381] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:06.219832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37823f-59bd-4e10-b5b7-95b3ea3fb83d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:06.220369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37823f-59bd-4e10-b5b7-95b3ea3fb83d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:06.220944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37823f-59bd-4e10-b5b7-95b3ea3fb83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:06.244041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0d37823f-59bd-4e10-b5b7-95b3ea3fb83d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:06.245753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0d37823f-59bd-4e10-b5b7-95b3ea3fb83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:06.329575 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 194/382] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:06.354458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013d7c7-db01-4110-b9e6-dc307bc6388e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:06.489562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013d7c7-db01-4110-b9e6-dc307bc6388e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:06.504100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602bed6-4b43-4a9a-9761-33cf78a508eb None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:06.504722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602bed6-4b43-4a9a-9761-33cf78a508eb None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:06.505199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602bed6-4b43-4a9a-9761-33cf78a508eb None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:06.507077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 195/383] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:06.521729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c608c-f516-4c33-8c6c-cc2b7e0709da None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:06.522336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c608c-f516-4c33-8c6c-cc2b7e0709da None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:06.522836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c608c-f516-4c33-8c6c-cc2b7e0709da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:06.542877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862e55-5def-4ab8-9a6b-3c91b520877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:06.544065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862e55-5def-4ab8-9a6b-3c91b520877d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:06.546249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862e55-5def-4ab8-9a6b-3c91b520877d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:06.546753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862e55-5def-4ab8-9a6b-3c91b520877d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:06.556882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1e9c608c-f516-4c33-8c6c-cc2b7e0709da None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:06.559385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1e9c608c-f516-4c33-8c6c-cc2b7e0709da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:06.573293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862e55-5def-4ab8-9a6b-3c91b520877d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-fb862e55-5def-4ab8-9a6b-3c91b520877d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:06.581628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:06.582464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:06.583233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:06.591670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 189/384] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:06.597810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862e55-5def-4ab8-9a6b-3c91b520877d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:06.661327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 196/385] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:06.696053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c608c-f516-4c33-8c6c-cc2b7e0709da None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:06.739495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862e55-5def-4ab8-9a6b-3c91b520877d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:06.775410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:06.776351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:06.777000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:06.777491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:06.778554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:06.779066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:06.780652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:06.790472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 190/386] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:06.796581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:06.804244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c608c-f516-4c33-8c6c-cc2b7e0709da None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:06.842587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a98fed-aa87-4847-842d-419ce0fc51a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:06.843609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98fed-aa87-4847-842d-419ce0fc51a1 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:06.844076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98fed-aa87-4847-842d-419ce0fc51a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:06.844747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a98fed-aa87-4847-842d-419ce0fc51a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:06.855888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a98fed-aa87-4847-842d-419ce0fc51a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-05a98fed-aa87-4847-842d-419ce0fc51a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:06.864409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:06.865279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:06.866078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:06.868777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 197/387] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:06.874870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a98fed-aa87-4847-842d-419ce0fc51a1 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:06.918111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dfc27-2e04-4763-8560-49fd10b264c8 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:06.990087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a98fed-aa87-4847-842d-419ce0fc51a1 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:07.002280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc2b0-c570-4d6b-89b0-10482033647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:07.003402 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc2b0-c570-4d6b-89b0-10482033647c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.003828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc2b0-c570-4d6b-89b0-10482033647c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.004250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc2b0-c570-4d6b-89b0-10482033647c None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.005651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc2b0-c570-4d6b-89b0-10482033647c None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:07.007270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc2b0-c570-4d6b-89b0-10482033647c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:07.009408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 191/388] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:06 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:07.014864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc2b0-c570-4d6b-89b0-10482033647c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:07.028641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:07.029762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.030158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.030532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.031541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:07.032099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:07.034782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:07.045064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 198/389] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:07.054641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:07.125239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc2b0-c570-4d6b-89b0-10482033647c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:07.160428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b958-afb6-4533-8d98-80da9f19cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:07.161629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b958-afb6-4533-8d98-80da9f19cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.162066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b958-afb6-4533-8d98-80da9f19cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.162482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013b958-afb6-4533-8d98-80da9f19cbb2 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.167297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013b958-afb6-4533-8d98-80da9f19cbb2 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:07.170562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013b958-afb6-4533-8d98-80da9f19cbb2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:07.172449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 192/390] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:07 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:07.181043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b958-afb6-4533-8d98-80da9f19cbb2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:07.218130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677efdf-ed58-45be-9128-47f55f05436c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:07.283489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1f3a6-adc1-4cfe-9cbc-72862e3fbd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:07.284677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1f3a6-adc1-4cfe-9cbc-72862e3fbd87 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.285112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1f3a6-adc1-4cfe-9cbc-72862e3fbd87 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.285524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1f3a6-adc1-4cfe-9cbc-72862e3fbd87 None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.287212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1f3a6-adc1-4cfe-9cbc-72862e3fbd87 None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:07.288945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1f3a6-adc1-4cfe-9cbc-72862e3fbd87 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:07.293922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 199/391] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:07 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:07.299582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1f3a6-adc1-4cfe-9cbc-72862e3fbd87 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:07.375517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013b958-afb6-4533-8d98-80da9f19cbb2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:07.415668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795db49-1825-4e56-b551-9e47579af14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:07.416919 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795db49-1825-4e56-b551-9e47579af14f None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.417342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795db49-1825-4e56-b551-9e47579af14f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.417786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795db49-1825-4e56-b551-9e47579af14f None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3/groups/e3f5781c481b4e64a4c088ba7e12f7bc/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.419903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795db49-1825-4e56-b551-9e47579af14f None admin] RBAC: Authorizing `identity:create_grant(project_id=52ce4f52f95b46479b0949667e03c0d3, group_id=e3f5781c481b4e64a4c088ba7e12f7bc, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:07.421497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795db49-1825-4e56-b551-9e47579af14f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:07.441819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 193/392] 10.222.0.36 () {58 vars in 1442 bytes} [Wed May 11 07:25:07 2022] PUT /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3/groups/e3f5781c481b4e64a4c088ba7e12f7bc/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:07.479065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1f3a6-adc1-4cfe-9cbc-72862e3fbd87 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:07.510617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fe4c9-e948-47d3-8977-dfa75908f4f4 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.510964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fe4c9-e948-47d3-8977-dfa75908f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.511169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fe4c9-e948-47d3-8977-dfa75908f4f4 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.512562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 194/393] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:07.522128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7992b9-8c96-4748-841e-2ba20eebcf3c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.522511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7992b9-8c96-4748-841e-2ba20eebcf3c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.522795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7992b9-8c96-4748-841e-2ba20eebcf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.533215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521735d-ed0f-4367-850c-084f963e2da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:07.534232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521735d-ed0f-4367-850c-084f963e2da7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.534459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521735d-ed0f-4367-850c-084f963e2da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.534803 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521735d-ed0f-4367-850c-084f963e2da7 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.537374 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521735d-ed0f-4367-850c-084f963e2da7 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:07.539620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521735d-ed0f-4367-850c-084f963e2da7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:07.542215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 200/394] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:07 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:07.550017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3e7992b9-8c96-4748-841e-2ba20eebcf3c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:07.551264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3e7992b9-8c96-4748-841e-2ba20eebcf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:07.552544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521735d-ed0f-4367-850c-084f963e2da7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:07.679292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521735d-ed0f-4367-850c-084f963e2da7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:07.721379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e8b18-0925-4d9a-8fe0-60668ea18935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:07.722603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e8b18-0925-4d9a-8fe0-60668ea18935 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.722906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e8b18-0925-4d9a-8fe0-60668ea18935 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.723176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e8b18-0925-4d9a-8fe0-60668ea18935 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3/groups/e3f5781c481b4e64a4c088ba7e12f7bc/roles/aa78a08951eb49f78aeda141988844de` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.725982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e8b18-0925-4d9a-8fe0-60668ea18935 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ce4f52f95b46479b0949667e03c0d3, group_id=e3f5781c481b4e64a4c088ba7e12f7bc, role_id=aa78a08951eb49f78aeda141988844de)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:07.727434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e8b18-0925-4d9a-8fe0-60668ea18935 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:07.743705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 201/395] 10.222.0.36 () {58 vars in 1442 bytes} [Wed May 11 07:25:07 2022] PUT /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3/groups/e3f5781c481b4e64a4c088ba7e12f7bc/roles/aa78a08951eb49f78aeda141988844de => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:07.753915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 195/396] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:07.778494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e8b18-0925-4d9a-8fe0-60668ea18935 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:07.890825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e8b18-0925-4d9a-8fe0-60668ea18935 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:07.926849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83c905-96ca-473f-a5f9-6bbf643effb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:07.927666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83c905-96ca-473f-a5f9-6bbf643effb9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:07.927950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83c905-96ca-473f-a5f9-6bbf643effb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:07.928225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83c905-96ca-473f-a5f9-6bbf643effb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:07.940629 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83c905-96ca-473f-a5f9-6bbf643effb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ed83c905-96ca-473f-a5f9-6bbf643effb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:07.948880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:07.949841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:07.950586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 202/397] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:07.958731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7992b9-8c96-4748-841e-2ba20eebcf3c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:08.066695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7992b9-8c96-4748-841e-2ba20eebcf3c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:08.104947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:08.105699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:08.105983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:08.106304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:08.107061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:08.107366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:08.108737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:08.122539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 196/398] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:25:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:08.128110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83c905-96ca-473f-a5f9-6bbf643effb9 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:08.268998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83c905-96ca-473f-a5f9-6bbf643effb9 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:08.305391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3abbb-6515-4d70-944f-f69ae6853867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:08.306672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3abbb-6515-4d70-944f-f69ae6853867 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:08.307155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3abbb-6515-4d70-944f-f69ae6853867 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:08.307649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3abbb-6515-4d70-944f-f69ae6853867 None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:08.309038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3abbb-6515-4d70-944f-f69ae6853867 None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:08.310877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3abbb-6515-4d70-944f-f69ae6853867 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:08.312954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 203/399] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:08 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:08.318626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:08.322935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dabc56-2bd6-4cd4-b5ad-3bd884d19cf5 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:08.323463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dabc56-2bd6-4cd4-b5ad-3bd884d19cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:08.323959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dabc56-2bd6-4cd4-b5ad-3bd884d19cf5 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:08.325505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 204/400] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:08.331134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09661-4f05-4ce7-a1ce-26edbcbb5438 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:08.331420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09661-4f05-4ce7-a1ce-26edbcbb5438 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:08.331704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09661-4f05-4ce7-a1ce-26edbcbb5438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:08.354767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-25d09661-4f05-4ce7-a1ce-26edbcbb5438 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:08.355951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-25d09661-4f05-4ce7-a1ce-26edbcbb5438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:08.444180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9250bd-8bf7-401d-a45f-31b1b77fe6b4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:08.488733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab21b9-cc12-4de2-be1e-5fb623a32f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:08.489636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab21b9-cc12-4de2-be1e-5fb623a32f3c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:08.489922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab21b9-cc12-4de2-be1e-5fb623a32f3c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:08.490238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab21b9-cc12-4de2-be1e-5fb623a32f3c None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:08.492393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab21b9-cc12-4de2-be1e-5fb623a32f3c None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:08.496119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab21b9-cc12-4de2-be1e-5fb623a32f3c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:08.497875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 197/401] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:08 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:08.506047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 205/402] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:08.506558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab21b9-cc12-4de2-be1e-5fb623a32f3c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:08.530552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09661-4f05-4ce7-a1ce-26edbcbb5438 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:08.618822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab21b9-cc12-4de2-be1e-5fb623a32f3c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:08.656971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2be6b-4522-433e-86df-6846c732e373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:08.657896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2be6b-4522-433e-86df-6846c732e373 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:08.658246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2be6b-4522-433e-86df-6846c732e373 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:08.659016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2be6b-4522-433e-86df-6846c732e373 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/groups/e3f5781c481b4e64a4c088ba7e12f7bc/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:08.660990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2be6b-4522-433e-86df-6846c732e373 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf, group_id=e3f5781c481b4e64a4c088ba7e12f7bc, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:08.662483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2be6b-4522-433e-86df-6846c732e373 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:08.669924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09661-4f05-4ce7-a1ce-26edbcbb5438 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:08.691352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 198/403] 10.222.0.36 () {58 vars in 1442 bytes} [Wed May 11 07:25:08 2022] PUT /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/groups/e3f5781c481b4e64a4c088ba7e12f7bc/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:08.712257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49bbc-09ed-4324-a63c-1211ad2a5d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:08.713111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49bbc-09ed-4324-a63c-1211ad2a5d44 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:08.713389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49bbc-09ed-4324-a63c-1211ad2a5d44 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:08.713706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49bbc-09ed-4324-a63c-1211ad2a5d44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:08.731483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa49bbc-09ed-4324-a63c-1211ad2a5d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-4aa49bbc-09ed-4324-a63c-1211ad2a5d44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:08.740669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:08.742872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:08.744481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 206/404] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:08.749072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2be6b-4522-433e-86df-6846c732e373 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:08.870726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2be6b-4522-433e-86df-6846c732e373 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:08.907808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70cacb-cc39-4615-8534-0c9e340a4faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:08.908524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70cacb-cc39-4615-8534-0c9e340a4faf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:08.911905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70cacb-cc39-4615-8534-0c9e340a4faf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:08.911905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70cacb-cc39-4615-8534-0c9e340a4faf None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:08.911905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70cacb-cc39-4615-8534-0c9e340a4faf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:08.911905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70cacb-cc39-4615-8534-0c9e340a4faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:08.911905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70cacb-cc39-4615-8534-0c9e340a4faf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:08.940837 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 199/405] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:08.957589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49bbc-09ed-4324-a63c-1211ad2a5d44 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:09.058856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ebdc-45f4-4588-9850-547fcf9ea251 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:09.059439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ebdc-45f4-4588-9850-547fcf9ea251 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:09.059439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ebdc-45f4-4588-9850-547fcf9ea251 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:09.060790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 200/406] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:09.067366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc1be-9119-46f5-bbae-f5555896f1b1 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:09.067647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc1be-9119-46f5-bbae-f5555896f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:09.068140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc1be-9119-46f5-bbae-f5555896f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:09.106520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-25adc1be-9119-46f5-bbae-f5555896f1b1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:09.107714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-25adc1be-9119-46f5-bbae-f5555896f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:09.135283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49bbc-09ed-4324-a63c-1211ad2a5d44 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:09.196376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d16e6-ed1b-4de3-a9ca-509f77f3c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:09.197078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d16e6-ed1b-4de3-a9ca-509f77f3c327 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:09.197343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d16e6-ed1b-4de3-a9ca-509f77f3c327 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:09.197639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d16e6-ed1b-4de3-a9ca-509f77f3c327 None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:09.200965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d16e6-ed1b-4de3-a9ca-509f77f3c327 None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:09.202422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d16e6-ed1b-4de3-a9ca-509f77f3c327 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:09.205598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 207/407] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:08 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:09.211162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d16e6-ed1b-4de3-a9ca-509f77f3c327 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:09.244409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 201/408] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:09.270251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc1be-9119-46f5-bbae-f5555896f1b1 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:09.429592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d16e6-ed1b-4de3-a9ca-509f77f3c327 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:09.472311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc1be-9119-46f5-bbae-f5555896f1b1 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:09.501978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560f50d-51d3-4aac-ab5a-eeeddc6ef2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:09.505785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560f50d-51d3-4aac-ab5a-eeeddc6ef2d3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:09.506418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560f50d-51d3-4aac-ab5a-eeeddc6ef2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:09.507321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560f50d-51d3-4aac-ab5a-eeeddc6ef2d3 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:09.509744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560f50d-51d3-4aac-ab5a-eeeddc6ef2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:09.511406 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560f50d-51d3-4aac-ab5a-eeeddc6ef2d3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:09.513485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 208/409] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:09 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:09.520238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560f50d-51d3-4aac-ab5a-eeeddc6ef2d3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:09.539334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e87c-6673-4b97-9183-ab88fa0da4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:09.540162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e87c-6673-4b97-9183-ab88fa0da4d4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:09.540615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e87c-6673-4b97-9183-ab88fa0da4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:09.540718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e87c-6673-4b97-9183-ab88fa0da4d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:09.562453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e87c-6673-4b97-9183-ab88fa0da4d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-2d78e87c-6673-4b97-9183-ab88fa0da4d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:09.576954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:09.578009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:09.578794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:09.586473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 202/410] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:09.594524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e87c-6673-4b97-9183-ab88fa0da4d4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:09.643837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560f50d-51d3-4aac-ab5a-eeeddc6ef2d3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:09.698325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0c7b-3fac-4860-b9be-24132b33f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:09.699581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0c7b-3fac-4860-b9be-24132b33f074 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:09.700062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0c7b-3fac-4860-b9be-24132b33f074 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:09.700547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0c7b-3fac-4860-b9be-24132b33f074 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/groups/e3f5781c481b4e64a4c088ba7e12f7bc/roles/aa78a08951eb49f78aeda141988844de` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:09.710334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b0c7b-3fac-4860-b9be-24132b33f074 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf, group_id=e3f5781c481b4e64a4c088ba7e12f7bc, role_id=aa78a08951eb49f78aeda141988844de)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:09.712089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b0c7b-3fac-4860-b9be-24132b33f074 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:09.744190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 209/411] 10.222.0.36 () {58 vars in 1442 bytes} [Wed May 11 07:25:09 2022] PUT /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf/groups/e3f5781c481b4e64a4c088ba7e12f7bc/roles/aa78a08951eb49f78aeda141988844de => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:09.755824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e87c-6673-4b97-9183-ab88fa0da4d4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:09.804448 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:09.805126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:09.805408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:09.805712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:09.806464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:09.806769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:09.808153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:09.824595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 203/412] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:09.831094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0c7b-3fac-4860-b9be-24132b33f074 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:10.051462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0c7b-3fac-4860-b9be-24132b33f074 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:10.089042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4009b-3229-4174-bc09-f903e9822029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:10.090288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4009b-3229-4174-bc09-f903e9822029 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:10.090815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4009b-3229-4174-bc09-f903e9822029 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:10.091299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4009b-3229-4174-bc09-f903e9822029 None admin] PATH_INFO: `/v3/groups/2f14c35bcf1e4e35a267ff0be957894a` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:10.093936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4009b-3229-4174-bc09-f903e9822029 None admin] RBAC: Authorizing `identity:get_group(group_id=2f14c35bcf1e4e35a267ff0be957894a)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:10.095669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4009b-3229-4174-bc09-f903e9822029 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:10.098389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 210/413] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:09 2022] GET /identity/v3/groups/2f14c35bcf1e4e35a267ff0be957894a => generated 229 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:10.103507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:10.224888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d8317-0ed1-460c-8605-ed112f90f322 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:10.266789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612743f-e905-4996-8f72-e5329c3393ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:10.268599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612743f-e905-4996-8f72-e5329c3393ad None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:10.269107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612743f-e905-4996-8f72-e5329c3393ad None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:10.269611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612743f-e905-4996-8f72-e5329c3393ad None admin] PATH_INFO: `/v3/projects/5da8d434269248bf956fab772dd66ddd` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:10.271018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612743f-e905-4996-8f72-e5329c3393ad None admin] RBAC: Authorizing `identity:get_project(project_id=5da8d434269248bf956fab772dd66ddd)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:10.272680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612743f-e905-4996-8f72-e5329c3393ad None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:10.275609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 204/414] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:10 2022] GET /identity/v3/projects/5da8d434269248bf956fab772dd66ddd => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:10.280217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4009b-3229-4174-bc09-f903e9822029 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:10.432082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4009b-3229-4174-bc09-f903e9822029 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:10.494279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d5e28-d5f4-4675-8277-afb4a2b6d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:10.495186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d5e28-d5f4-4675-8277-afb4a2b6d6bb None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:10.495469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d5e28-d5f4-4675-8277-afb4a2b6d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:10.495742 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d5e28-d5f4-4675-8277-afb4a2b6d6bb None admin] PATH_INFO: `/v3/projects/5da8d434269248bf956fab772dd66ddd/groups/2f14c35bcf1e4e35a267ff0be957894a/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:10.497782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d5e28-d5f4-4675-8277-afb4a2b6d6bb None admin] RBAC: Authorizing `identity:create_grant(project_id=5da8d434269248bf956fab772dd66ddd, group_id=2f14c35bcf1e4e35a267ff0be957894a, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:10.499218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d5e28-d5f4-4675-8277-afb4a2b6d6bb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:10.530480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c657130-be13-44df-9b0d-6e409c023053 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:10.531466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c657130-be13-44df-9b0d-6e409c023053 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:10.531948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c657130-be13-44df-9b0d-6e409c023053 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:10.537356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 205/415] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:10.541316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 211/416] 10.222.0.36 () {58 vars in 1442 bytes} [Wed May 11 07:25:10 2022] PUT /identity/v3/projects/5da8d434269248bf956fab772dd66ddd/groups/2f14c35bcf1e4e35a267ff0be957894a/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:10.542585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc6f07-f60e-4049-9110-2e0bdfcc8fb7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:10.542881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc6f07-f60e-4049-9110-2e0bdfcc8fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:10.543162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc6f07-f60e-4049-9110-2e0bdfcc8fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:10.569820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-03dc6f07-f60e-4049-9110-2e0bdfcc8fb7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:10.571010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-03dc6f07-f60e-4049-9110-2e0bdfcc8fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:10.671144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 206/417] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:10.713835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d5e28-d5f4-4675-8277-afb4a2b6d6bb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:10.827585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a6bbb-e01e-4fe4-bfce-c8e2daee7acf None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:10.827772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a6bbb-e01e-4fe4-bfce-c8e2daee7acf None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:10.828035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a6bbb-e01e-4fe4-bfce-c8e2daee7acf None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:10.830268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 207/418] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:10.845591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1118fad-6468-45c0-93aa-7a6abd585345 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:10.845591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1118fad-6468-45c0-93aa-7a6abd585345 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:10.845591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1118fad-6468-45c0-93aa-7a6abd585345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:10.877580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c1118fad-6468-45c0-93aa-7a6abd585345 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:10.877580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c1118fad-6468-45c0-93aa-7a6abd585345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:10.883771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d5e28-d5f4-4675-8277-afb4a2b6d6bb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:10.933999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f33716-674c-4295-820c-347671469665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:10.934823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f33716-674c-4295-820c-347671469665 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:10.935101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f33716-674c-4295-820c-347671469665 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:10.935371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f33716-674c-4295-820c-347671469665 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:10.953759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f33716-674c-4295-820c-347671469665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-c2f33716-674c-4295-820c-347671469665 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:10.961670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:10.962543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:10.964615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 212/419] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:10.971207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f33716-674c-4295-820c-347671469665 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:11.045525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 208/420] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:11.112199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1118fad-6468-45c0-93aa-7a6abd585345 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:11.215503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f33716-674c-4295-820c-347671469665 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:11.252275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1118fad-6468-45c0-93aa-7a6abd585345 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:11.293815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b22b-a9cf-4b90-9521-0036c9519318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:11.294884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b22b-a9cf-4b90-9521-0036c9519318 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:11.294884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b22b-a9cf-4b90-9521-0036c9519318 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:11.295187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b22b-a9cf-4b90-9521-0036c9519318 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:11.300016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:11.300686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:11.300966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:11.301236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:11.302026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:11.302331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:11.303703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:11.318778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b22b-a9cf-4b90-9521-0036c9519318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e732b22b-a9cf-4b90-9521-0036c9519318 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:11.326966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:11.327810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:11.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:11.331205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 213/421] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:11.331334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 209/422] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:11.338463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:11.343054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b22b-a9cf-4b90-9521-0036c9519318 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:11.453113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b22b-a9cf-4b90-9521-0036c9519318 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:11.493517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e6f0-81d2-4ae3-83d0-859db23eb0e0 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:11.498764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31d723-24fc-4cf7-9e36-681dc97d5bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:11.499425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d723-24fc-4cf7-9e36-681dc97d5bf8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:11.499712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d723-24fc-4cf7-9e36-681dc97d5bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:11.499989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31d723-24fc-4cf7-9e36-681dc97d5bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:11.536843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:11.537575 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:11.537865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:11.538138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:11.538885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:11.539192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:11.540679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:11.562672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 214/423] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:11.565637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:11.589249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31d723-24fc-4cf7-9e36-681dc97d5bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:11.590756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31d723-24fc-4cf7-9e36-681dc97d5bf8 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:11.688860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 210/424] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:11.694315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31d723-24fc-4cf7-9e36-681dc97d5bf8 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:11.750663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878feb2e-d8b7-4ff5-9b39-d03188a4f386 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:11.796271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31d723-24fc-4cf7-9e36-681dc97d5bf8 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:11.828305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56f80d-f72a-490a-aba8-aa7473d40b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:11.830768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f80d-f72a-490a-aba8-aa7473d40b71 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:11.832132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f80d-f72a-490a-aba8-aa7473d40b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:11.832414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56f80d-f72a-490a-aba8-aa7473d40b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:11.834726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d9e1-a470-41de-987c-c98ded1dc650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:11.835588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d9e1-a470-41de-987c-c98ded1dc650 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:11.835868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d9e1-a470-41de-987c-c98ded1dc650 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:11.836140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d9e1-a470-41de-987c-c98ded1dc650 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:11.839026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1d9e1-a470-41de-987c-c98ded1dc650 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:11.840478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1d9e1-a470-41de-987c-c98ded1dc650 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:11.852671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 211/425] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:11 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:11.853582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d9e1-a470-41de-987c-c98ded1dc650 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:11.967897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56f80d-f72a-490a-aba8-aa7473d40b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:11.970666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56f80d-f72a-490a-aba8-aa7473d40b71 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:11.997507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d9e1-a470-41de-987c-c98ded1dc650 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:12.032252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdd785-51a3-46a1-a5a9-5571fddfec0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:12.033145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd785-51a3-46a1-a5a9-5571fddfec0d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.033425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd785-51a3-46a1-a5a9-5571fddfec0d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.033727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdd785-51a3-46a1-a5a9-5571fddfec0d None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.035578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdd785-51a3-46a1-a5a9-5571fddfec0d None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:12.036563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdd785-51a3-46a1-a5a9-5571fddfec0d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:12.038406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 212/426] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:11 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:12.039870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe435-1ca9-471d-acbc-a01169e07b1e None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.040143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe435-1ca9-471d-acbc-a01169e07b1e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.040416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffe435-1ca9-471d-acbc-a01169e07b1e None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.045941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 213/427] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:12.047693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071fbd8-33b3-4cbf-b3f2-59a0c71a0562 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.047982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071fbd8-33b3-4cbf-b3f2-59a0c71a0562 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.048257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071fbd8-33b3-4cbf-b3f2-59a0c71a0562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.066303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0071fbd8-33b3-4cbf-b3f2-59a0c71a0562 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:12.067535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0071fbd8-33b3-4cbf-b3f2-59a0c71a0562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:12.094465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 215/428] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:12.095603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56f80d-f72a-490a-aba8-aa7473d40b71 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:12.148289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 214/429] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:12.149342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071fbd8-33b3-4cbf-b3f2-59a0c71a0562 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:12.219371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56f80d-f72a-490a-aba8-aa7473d40b71 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:12.247295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071fbd8-33b3-4cbf-b3f2-59a0c71a0562 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:12.253454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:12.254143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.254420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.254689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.255627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] RBAC: Adding query filter params (group.id=e3f5781c481b4e64a4c088ba7e12f7bc, role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=52ce4f52f95b46479b0949667e03c0d3) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:12.255988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:12.257436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:12.263938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 216/430] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/role_assignments?group.id=e3f5781c481b4e64a4c088ba7e12f7bc&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:12.264783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:12.300192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243638-930e-4a36-aec2-9d36bf001d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:12.300998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243638-930e-4a36-aec2-9d36bf001d69 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.301275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243638-930e-4a36-aec2-9d36bf001d69 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.301589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8243638-930e-4a36-aec2-9d36bf001d69 None admin] PATH_INFO: `/v3/projects/52ce4f52f95b46479b0949667e03c0d3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.302823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8243638-930e-4a36-aec2-9d36bf001d69 None admin] RBAC: Authorizing `identity:get_project(project_id=52ce4f52f95b46479b0949667e03c0d3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:12.304260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8243638-930e-4a36-aec2-9d36bf001d69 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:12.306277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 215/431] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/projects/52ce4f52f95b46479b0949667e03c0d3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:12.320061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243638-930e-4a36-aec2-9d36bf001d69 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:12.373133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df000797-1f59-47c4-8abe-2f8a8396644a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:12.407711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65fcf-a6be-4736-9ff5-51cc9171bb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:12.408549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65fcf-a6be-4736-9ff5-51cc9171bb69 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.408829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65fcf-a6be-4736-9ff5-51cc9171bb69 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.409103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb65fcf-a6be-4736-9ff5-51cc9171bb69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.420822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb65fcf-a6be-4736-9ff5-51cc9171bb69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ffb65fcf-a6be-4736-9ff5-51cc9171bb69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:12.429404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:12.430396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 07:25:12.431168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:12.435830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 217/432] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:12.437585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65fcf-a6be-4736-9ff5-51cc9171bb69 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:12.521488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8243638-930e-4a36-aec2-9d36bf001d69 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:12.542467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb65fcf-a6be-4736-9ff5-51cc9171bb69 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:12.578328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:12.578951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.579238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.579462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.580276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] RBAC: Adding query filter params (name=member) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:12.580588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:12.582013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:12.595387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 218/433] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:12.597178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:12.606012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98360567-5a48-48f2-8898-af7929ff8614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:12.606931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98360567-5a48-48f2-8898-af7929ff8614 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.607211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98360567-5a48-48f2-8898-af7929ff8614 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.607483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98360567-5a48-48f2-8898-af7929ff8614 None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.608708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98360567-5a48-48f2-8898-af7929ff8614 None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:12.610176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98360567-5a48-48f2-8898-af7929ff8614 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:12.612729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 216/434] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:12.623953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4505-a7cf-4504-9a32-2e95ffd4c2ad None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.624245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4505-a7cf-4504-9a32-2e95ffd4c2ad None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.624529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a4505-a7cf-4504-9a32-2e95ffd4c2ad None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.626161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 217/435] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:12.629046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a4505-a7cf-4504-9a32-2e95ffd4c2ad None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:12.709997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2c7-2099-4f85-a1cb-dbf4f0aebc69 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:12.759907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a8ad-8067-47c2-9cd5-78cb643b254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:12.760562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a8ad-8067-47c2-9cd5-78cb643b254c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.760844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a8ad-8067-47c2-9cd5-78cb643b254c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.761116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a8ad-8067-47c2-9cd5-78cb643b254c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.761374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a4505-a7cf-4504-9a32-2e95ffd4c2ad None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:12.803821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924de1c-33c6-4d41-a752-5ecb0c3deb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:12.804485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924de1c-33c6-4d41-a752-5ecb0c3deb0e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.804765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924de1c-33c6-4d41-a752-5ecb0c3deb0e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.805085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924de1c-33c6-4d41-a752-5ecb0c3deb0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.806437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924de1c-33c6-4d41-a752-5ecb0c3deb0e None admin] RBAC: Adding query filter params (group.id=e3f5781c481b4e64a4c088ba7e12f7bc, role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=52ce4f52f95b46479b0949667e03c0d3) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:12.806761 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924de1c-33c6-4d41-a752-5ecb0c3deb0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:12.808197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924de1c-33c6-4d41-a752-5ecb0c3deb0e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:12.817358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 218/436] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/role_assignments?group.id=e3f5781c481b4e64a4c088ba7e12f7bc&scope.project.id=52ce4f52f95b46479b0949667e03c0d3&role.id=aa78a08951eb49f78aeda141988844de => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:12.823300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae4309-a929-468b-ab79-2354d6db9a53 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:12.823606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae4309-a929-468b-ab79-2354d6db9a53 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:12.823860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae4309-a929-468b-ab79-2354d6db9a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:12.849782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8eae4309-a929-468b-ab79-2354d6db9a53 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:12.851254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8eae4309-a929-468b-ab79-2354d6db9a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:12.859240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a8ad-8067-47c2-9cd5-78cb643b254c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:12.860754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a8ad-8067-47c2-9cd5-78cb643b254c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:12.957138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 219/437] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:12.981897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 219/438] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:25:12.983646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae4309-a929-468b-ab79-2354d6db9a53 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:12.987702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a8ad-8067-47c2-9cd5-78cb643b254c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.121764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a8ad-8067-47c2-9cd5-78cb643b254c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.121929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae4309-a929-468b-ab79-2354d6db9a53 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.166182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5998-6c87-4077-8705-4d2d807bd44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.167009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5998-6c87-4077-8705-4d2d807bd44f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.167297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5998-6c87-4077-8705-4d2d807bd44f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.167424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc368-a749-4b5e-b2c8-cee92cfa9b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.167612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5998-6c87-4077-8705-4d2d807bd44f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.168282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc368-a749-4b5e-b2c8-cee92cfa9b76 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.168561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc368-a749-4b5e-b2c8-cee92cfa9b76 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.168829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc368-a749-4b5e-b2c8-cee92cfa9b76 None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.170090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbc368-a749-4b5e-b2c8-cee92cfa9b76 None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:13.171520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbc368-a749-4b5e-b2c8-cee92cfa9b76 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:13.173396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 220/439] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:13.178337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e5998-6c87-4077-8705-4d2d807bd44f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:13.178584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc368-a749-4b5e-b2c8-cee92cfa9b76 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-ba2e5998-6c87-4077-8705-4d2d807bd44f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:13.187888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:13.188795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:13.189639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:13.191147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 220/440] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:13.197509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5998-6c87-4077-8705-4d2d807bd44f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.300749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc368-a749-4b5e-b2c8-cee92cfa9b76 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.313695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5998-6c87-4077-8705-4d2d807bd44f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.334717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c12d8-d6bc-4b89-9f8a-14cbca5cbd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.335581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c12d8-d6bc-4b89-9f8a-14cbca5cbd9c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.335860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c12d8-d6bc-4b89-9f8a-14cbca5cbd9c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.336141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c12d8-d6bc-4b89-9f8a-14cbca5cbd9c None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.337303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c12d8-d6bc-4b89-9f8a-14cbca5cbd9c None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:13.338779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c12d8-d6bc-4b89-9f8a-14cbca5cbd9c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:13.340382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 221/441] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:13.341568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fcddc-7d99-4a23-928a-12f6f7d2d252 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.341853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fcddc-7d99-4a23-928a-12f6f7d2d252 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.342131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fcddc-7d99-4a23-928a-12f6f7d2d252 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.343343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 222/442] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:13.346029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fcddc-7d99-4a23-928a-12f6f7d2d252 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.347720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3a322-dd65-43c6-a301-0882b0da6c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.348384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a322-dd65-43c6-a301-0882b0da6c1a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.348666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a322-dd65-43c6-a301-0882b0da6c1a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.348936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3a322-dd65-43c6-a301-0882b0da6c1a None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.349707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a322-dd65-43c6-a301-0882b0da6c1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:13.350018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a322-dd65-43c6-a301-0882b0da6c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:13.351383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3a322-dd65-43c6-a301-0882b0da6c1a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:13.359185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 221/443] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:13.360397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f13b4-a28b-4435-b6a6-0fdc5cb6dc6a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.360686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f13b4-a28b-4435-b6a6-0fdc5cb6dc6a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.360960 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f13b4-a28b-4435-b6a6-0fdc5cb6dc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.377516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b46f13b4-a28b-4435-b6a6-0fdc5cb6dc6a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:13.378652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b46f13b4-a28b-4435-b6a6-0fdc5cb6dc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:13.438983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 222/444] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:13.440361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f13b4-a28b-4435-b6a6-0fdc5cb6dc6a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.449054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fcddc-7d99-4a23-928a-12f6f7d2d252 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.483038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.483922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.484202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.484479 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.485296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] RBAC: Adding query filter params (group.id=e3f5781c481b4e64a4c088ba7e12f7bc, role.id=e6b936a5820f443fb9310f7cdfe7a1f6, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:13.485631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:13.487050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:13.492626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 223/445] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/role_assignments?group.id=e3f5781c481b4e64a4c088ba7e12f7bc&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=e6b936a5820f443fb9310f7cdfe7a1f6 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:13.493394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.541498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f13b4-a28b-4435-b6a6-0fdc5cb6dc6a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.578032 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396e574-0fc8-4b91-be2e-53dfe8b9762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.578686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396e574-0fc8-4b91-be2e-53dfe8b9762b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.578972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396e574-0fc8-4b91-be2e-53dfe8b9762b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.579242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396e574-0fc8-4b91-be2e-53dfe8b9762b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.603498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bb4cd-602c-4ab2-949a-539b8932db2a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.639318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d96-a22c-4c04-bf95-5c5d5bf37812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.640053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d96-a22c-4c04-bf95-5c5d5bf37812 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.640347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d96-a22c-4c04-bf95-5c5d5bf37812 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.640624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d3d96-a22c-4c04-bf95-5c5d5bf37812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.650333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396e574-0fc8-4b91-be2e-53dfe8b9762b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:13.651861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d3d96-a22c-4c04-bf95-5c5d5bf37812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:13.652099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396e574-0fc8-4b91-be2e-53dfe8b9762b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-626d3d96-a22c-4c04-bf95-5c5d5bf37812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:13.659851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:13.660788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:13.661743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 224/446] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:13.666954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d96-a22c-4c04-bf95-5c5d5bf37812 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.764623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 223/447] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:13.770484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396e574-0fc8-4b91-be2e-53dfe8b9762b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.776250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d3d96-a22c-4c04-bf95-5c5d5bf37812 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.815719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.816401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.816688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.816965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.817798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:13.818556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:13.819498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:13.828465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 225/448] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:13.834269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.883096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396e574-0fc8-4b91-be2e-53dfe8b9762b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.916816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f283e32-0c5e-4899-a4e1-a6e725af06db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.917700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f283e32-0c5e-4899-a4e1-a6e725af06db None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.917982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f283e32-0c5e-4899-a4e1-a6e725af06db None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.918251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f283e32-0c5e-4899-a4e1-a6e725af06db None admin] PATH_INFO: `/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:13.919419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f283e32-0c5e-4899-a4e1-a6e725af06db None admin] RBAC: Authorizing `identity:get_project(project_id=7a1e6e5f2c7043239f2e17c3cc78f7bf)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:13.920852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f283e32-0c5e-4899-a4e1-a6e725af06db None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:13.922552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 224/449] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/projects/7a1e6e5f2c7043239f2e17c3cc78f7bf => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:13.928326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f283e32-0c5e-4899-a4e1-a6e725af06db None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:13.935710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9485fb7-8298-47d9-ac45-059e26ef1f27 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:13.967291 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3e1b5-ab9e-484a-8c4d-537c6a3e09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:13.967979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3e1b5-ab9e-484a-8c4d-537c6a3e09d3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:13.968258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3e1b5-ab9e-484a-8c4d-537c6a3e09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:13.968530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3e1b5-ab9e-484a-8c4d-537c6a3e09d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:14.020578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f283e32-0c5e-4899-a4e1-a6e725af06db None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:14.031352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3e1b5-ab9e-484a-8c4d-537c6a3e09d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:14.032820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3e1b5-ab9e-484a-8c4d-537c6a3e09d3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:14.052162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67623cd-2578-40d7-a886-06c07eebdcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:14.052998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67623cd-2578-40d7-a886-06c07eebdcb5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:14.053270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67623cd-2578-40d7-a886-06c07eebdcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:14.053533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67623cd-2578-40d7-a886-06c07eebdcb5 None admin] PATH_INFO: `/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:14.054703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67623cd-2578-40d7-a886-06c07eebdcb5 None admin] RBAC: Authorizing `identity:get_group(group_id=e3f5781c481b4e64a4c088ba7e12f7bc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:14.056118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67623cd-2578-40d7-a886-06c07eebdcb5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:14.057738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 225/450] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/groups/e3f5781c481b4e64a4c088ba7e12f7bc => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:14.063660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67623cd-2578-40d7-a886-06c07eebdcb5 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:14.125440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 226/451] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:25:14.130871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3e1b5-ab9e-484a-8c4d-537c6a3e09d3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:14.154990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67623cd-2578-40d7-a886-06c07eebdcb5 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:14.187035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:14.187875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:14.188158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:14.188431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:14.189278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] RBAC: Adding query filter params (group.id=e3f5781c481b4e64a4c088ba7e12f7bc, role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:14.189616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:14.191048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:14.196584 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 226/452] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:14 2022] GET /identity/v3/role_assignments?group.id=e3f5781c481b4e64a4c088ba7e12f7bc&scope.project.id=7a1e6e5f2c7043239f2e17c3cc78f7bf&role.id=aa78a08951eb49f78aeda141988844de => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:14.223275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3e1b5-ab9e-484a-8c4d-537c6a3e09d3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:14.258356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a250-ef29-4beb-98f7-dae4588c7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:14.259244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a250-ef29-4beb-98f7-dae4588c7c3a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:14.259580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a250-ef29-4beb-98f7-dae4588c7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:14.259854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38a250-ef29-4beb-98f7-dae4588c7c3a None admin] PATH_INFO: `/v3/projects/5da8d434269248bf956fab772dd66ddd` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:14.261145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38a250-ef29-4beb-98f7-dae4588c7c3a None admin] RBAC: Authorizing `identity:get_project(project_id=5da8d434269248bf956fab772dd66ddd)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:14.262716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38a250-ef29-4beb-98f7-dae4588c7c3a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:14.264672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 227/453] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:25:14 2022] GET /identity/v3/projects/5da8d434269248bf956fab772dd66ddd => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:14.270230 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:14.369300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf2ddb-d14d-4277-8929-7537dd30341d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:14.402717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50795073-2970-4a7c-8522-c0adade9cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:14.403574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50795073-2970-4a7c-8522-c0adade9cf0b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:14.403854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50795073-2970-4a7c-8522-c0adade9cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:14.404127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50795073-2970-4a7c-8522-c0adade9cf0b None admin] PATH_INFO: `/v3/groups/2f14c35bcf1e4e35a267ff0be957894a` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:14.405295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50795073-2970-4a7c-8522-c0adade9cf0b None admin] RBAC: Authorizing `identity:get_group(group_id=2f14c35bcf1e4e35a267ff0be957894a)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:14.406802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50795073-2970-4a7c-8522-c0adade9cf0b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:14.408976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 227/454] 10.222.0.36 () {56 vars in 1180 bytes} [Wed May 11 07:25:14 2022] GET /identity/v3/groups/2f14c35bcf1e4e35a267ff0be957894a => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:14.414777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a250-ef29-4beb-98f7-dae4588c7c3a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:14.511069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38a250-ef29-4beb-98f7-dae4588c7c3a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:14.545108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706bbf-0269-4421-82e8-252f1bde7cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:14.545790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706bbf-0269-4421-82e8-252f1bde7cff None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:14.546072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706bbf-0269-4421-82e8-252f1bde7cff None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:14.546348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706bbf-0269-4421-82e8-252f1bde7cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:14.547164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a706bbf-0269-4421-82e8-252f1bde7cff None admin] RBAC: Adding query filter params (group.id=2f14c35bcf1e4e35a267ff0be957894a, role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=5da8d434269248bf956fab772dd66ddd) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:14.547477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a706bbf-0269-4421-82e8-252f1bde7cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:14.548934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a706bbf-0269-4421-82e8-252f1bde7cff None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:14.554652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 228/455] 10.222.0.36 () {56 vars in 1376 bytes} [Wed May 11 07:25:14 2022] GET /identity/v3/role_assignments?group.id=2f14c35bcf1e4e35a267ff0be957894a&scope.project.id=5da8d434269248bf956fab772dd66ddd&role.id=de114c58fdc8476ebab657e6f9359155 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:17.374809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b88d6-55a3-4c77-ba59-389c8240fb4b None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.375822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b88d6-55a3-4c77-ba59-389c8240fb4b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.376305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b88d6-55a3-4c77-ba59-389c8240fb4b None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.378470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 228/456] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:17.384107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0331d0-22bf-4d48-a9f4-7c29e8bb771f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.384888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0331d0-22bf-4d48-a9f4-7c29e8bb771f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.385359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0331d0-22bf-4d48-a9f4-7c29e8bb771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.410584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8e0331d0-22bf-4d48-a9f4-7c29e8bb771f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:17.412126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8e0331d0-22bf-4d48-a9f4-7c29e8bb771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:17.459119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49febf36-3367-4fee-852e-6ee5bef05231 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.459773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49febf36-3367-4fee-852e-6ee5bef05231 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.460239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49febf36-3367-4fee-852e-6ee5bef05231 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.463545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 229/457] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:17.468043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62da7-db84-4882-b736-93e6462b40a2 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.468597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62da7-db84-4882-b736-93e6462b40a2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.469065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62da7-db84-4882-b736-93e6462b40a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.493956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f8d62da7-db84-4882-b736-93e6462b40a2 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:17.495139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f8d62da7-db84-4882-b736-93e6462b40a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:17.506458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 229/458] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:17.507793 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9805d-f541-4c81-b5c7-cdddc5095d79 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.508082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9805d-f541-4c81-b5c7-cdddc5095d79 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.508361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9805d-f541-4c81-b5c7-cdddc5095d79 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.521527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 230/459] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:17.524762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701f509-42e1-4f33-b1ec-bf7caf0eee44 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.525055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701f509-42e1-4f33-b1ec-bf7caf0eee44 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.525333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701f509-42e1-4f33-b1ec-bf7caf0eee44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.553989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b701f509-42e1-4f33-b1ec-bf7caf0eee44 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:17.555334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b701f509-42e1-4f33-b1ec-bf7caf0eee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:17.577760 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 230/460] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:17.578927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d62da7-db84-4882-b736-93e6462b40a2 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:17.639590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 231/461] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:17.640648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701f509-42e1-4f33-b1ec-bf7caf0eee44 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:17.729568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d62da7-db84-4882-b736-93e6462b40a2 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:17.739976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701f509-42e1-4f33-b1ec-bf7caf0eee44 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:17.771860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:17.772750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.773120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.773395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.773934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:17.774899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.775315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.775724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.785331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:17.786581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:17.787095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:17.788350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:17.806422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:17.807519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:17.808551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:17.808551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:17.808551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:17.808551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:17.808784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:17.809528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:17.810389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:17.810389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:17.810389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:17.810389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:17.810389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 231/462] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:17.810389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:17.817855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 232/463] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:17.818951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:17.918785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be55407-560a-4f75-b753-db28c8ec04af None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:17.922507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f81fd-1a12-4841-901b-9325bca76d08 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:17.956321 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:17.957634 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.958156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.958665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.960628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:17.961570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:17.962015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:17.962432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:17.963317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:17.963882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:17.965446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:17.971511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:17.972986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:17.984104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 233/464] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:17.985214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:17.991622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:17.992647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:17.993615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:17.993615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:17.993615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:17.993615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:17.997533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 232/465] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:17.998384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:18.086612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803599-9a3f-4c59-b381-47549929b75d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:18.097071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77b55f-1f7b-496d-966d-3fa5d38a1aad None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:18.121264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:18.122199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.122624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.123059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.123927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:18.124375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:18.125925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:18.131360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dfa03-ae1b-4047-a26b-669cd21c0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:18.132031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa03-ae1b-4047-a26b-669cd21c0f3c None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.132316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa03-ae1b-4047-a26b-669cd21c0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.132594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa03-ae1b-4047-a26b-669cd21c0f3c None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.133294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dfa03-ae1b-4047-a26b-669cd21c0f3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:18.134757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dfa03-ae1b-4047-a26b-669cd21c0f3c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:18.143245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 234/466] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:18.144348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:18.164945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 233/467] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:25:17 2022] POST /identity/v3/users => generated 248 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:18.164945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4f54d-2b2a-48cb-b659-52e3e1d14d3d None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.164945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4f54d-2b2a-48cb-b659-52e3e1d14d3d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.164945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4f54d-2b2a-48cb-b659-52e3e1d14d3d None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.164945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 234/468] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:18.164945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4f54d-2b2a-48cb-b659-52e3e1d14d3d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:18.290649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b9b2c-105f-41de-982a-2931c4c855d3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:18.293197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4f54d-2b2a-48cb-b659-52e3e1d14d3d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:18.331438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16bf37-50c8-410f-b73f-48fdc8d2b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:18.332621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bf37-50c8-410f-b73f-48fdc8d2b047 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.333049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bf37-50c8-410f-b73f-48fdc8d2b047 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.333464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bf37-50c8-410f-b73f-48fdc8d2b047 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.333600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07c7b-b03d-4025-acda-75b47f0b2570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:18.334236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07c7b-b03d-4025-acda-75b47f0b2570 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.334515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07c7b-b03d-4025-acda-75b47f0b2570 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.334782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07c7b-b03d-4025-acda-75b47f0b2570 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.334968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16bf37-50c8-410f-b73f-48fdc8d2b047 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:18.335506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07c7b-b03d-4025-acda-75b47f0b2570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:18.335807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07c7b-b03d-4025-acda-75b47f0b2570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:18.336912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16bf37-50c8-410f-b73f-48fdc8d2b047 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:18.337260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07c7b-b03d-4025-acda-75b47f0b2570 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:18.352825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 235/469] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:18.354242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db2e0f-fcda-41b3-88cd-4ebd00daf2c5 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.354553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db2e0f-fcda-41b3-88cd-4ebd00daf2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.354801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db2e0f-fcda-41b3-88cd-4ebd00daf2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.367391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 235/470] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:25:18 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:18.374605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16bf37-50c8-410f-b73f-48fdc8d2b047 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:18.378403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b6db2e0f-fcda-41b3-88cd-4ebd00daf2c5 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:18.380689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b6db2e0f-fcda-41b3-88cd-4ebd00daf2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:18.474309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 236/471] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:18.504865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db2e0f-fcda-41b3-88cd-4ebd00daf2c5 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:18.507002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16bf37-50c8-410f-b73f-48fdc8d2b047 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:18.543675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fa141-1ea8-4049-b1bc-49ac977eb35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:18.544721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fa141-1ea8-4049-b1bc-49ac977eb35c None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.545203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fa141-1ea8-4049-b1bc-49ac977eb35c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.545719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fa141-1ea8-4049-b1bc-49ac977eb35c None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.546655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fa141-1ea8-4049-b1bc-49ac977eb35c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:18.548351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fa141-1ea8-4049-b1bc-49ac977eb35c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:18.574244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 236/472] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:25:18 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:18.575987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a34a5-6177-4e1e-9249-3942d4768720 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.576535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a34a5-6177-4e1e-9249-3942d4768720 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.577020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a34a5-6177-4e1e-9249-3942d4768720 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.578772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 237/473] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:18.586531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e3a2-ca66-40f8-9b4a-f47b083afa22 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.586843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e3a2-ca66-40f8-9b4a-f47b083afa22 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.587082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e3a2-ca66-40f8-9b4a-f47b083afa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.611106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-9165e3a2-ca66-40f8-9b4a-f47b083afa22 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:18.612678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9165e3a2-ca66-40f8-9b4a-f47b083afa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:18.632825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db2e0f-fcda-41b3-88cd-4ebd00daf2c5 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:18.675530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:18.676815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.677352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.677877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.693969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:18.695931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:18.705574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 238/474] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:18.719568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:18.720524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:18.721386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:18.721386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:18.721386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:18.721386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:18.721386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 237/475] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:18.726796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165e3a2-ca66-40f8-9b4a-f47b083afa22 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:18.733938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:18.852368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165e3a2-ca66-40f8-9b4a-f47b083afa22 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:18.855695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739354-b646-4244-9982-05ddebda9ef8 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:18.888501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:18.889165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.889447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.889746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.890476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:18.890780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:18.892287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:18.899158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:18.899846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:18.900134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:18.900415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:18.901672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:18.903363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:18.904135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 239/476] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:18.909515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:18.910489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.sql.core [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 07:25:18.910489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 07:25:18.910489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [parameters: {'id': '9c3268823ed34bd88239c4187c832dcf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 07:25:18.910489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79914) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application result = self._query(query) May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application conn.query(q) May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application result.read() May 11 07:25:18.932959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return ref.to_dict() May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 07:25:18.933969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application next(self.gen) May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application yield resource May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application next(self.gen) May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self.session.rollback() May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self.force_reraise() May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise self.value May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application session.commit() May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 07:25:18.934844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._prepare_impl() May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self.session.flush() May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._flush(objects) May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application compat.raise_( May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application flush_context.execute() May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rec.execute(self) May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 07:25:18.936484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 07:25:18.938137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application result = self._query(query) May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application conn.query(q) May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application result.read() May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 07:25:18.944867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [parameters: {'id': '9c3268823ed34bd88239c4187c832dcf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:18.946712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 07:25:18.948548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:18.949611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 238/477] 10.222.0.36 () {60 vars in 1131 bytes} [Wed May 11 07:25:18 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:18.949611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:19.038430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf5e4-b274-4eef-b060-832c4042d5f2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:19.075400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c827775-1df1-4792-8e60-f33b13375508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:19.076186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c827775-1df1-4792-8e60-f33b13375508 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:19.076539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c827775-1df1-4792-8e60-f33b13375508 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:19.076879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c827775-1df1-4792-8e60-f33b13375508 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:19.077774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c827775-1df1-4792-8e60-f33b13375508 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:19.079356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c827775-1df1-4792-8e60-f33b13375508 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:19.112485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 240/478] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:25:18 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:25:19.131844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b368c14-3575-44e0-a3d5-f78c74b6a835 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:19.169117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e89341-ef7c-443e-81ba-d4103bf0cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:19.170106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89341-ef7c-443e-81ba-d4103bf0cb94 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:19.170398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89341-ef7c-443e-81ba-d4103bf0cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:19.170728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e89341-ef7c-443e-81ba-d4103bf0cb94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:19.183633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e89341-ef7c-443e-81ba-d4103bf0cb94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-42e89341-ef7c-443e-81ba-d4103bf0cb94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:19.193462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:19.195912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:19.197874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 239/479] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:19.202983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c827775-1df1-4792-8e60-f33b13375508 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:19.366149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c827775-1df1-4792-8e60-f33b13375508 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:19.399398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb5510-2edd-4cb8-b585-2e093388fc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:19.400070 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5510-2edd-4cb8-b585-2e093388fc8e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:19.400358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5510-2edd-4cb8-b585-2e093388fc8e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:19.400633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb5510-2edd-4cb8-b585-2e093388fc8e None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:19.401390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb5510-2edd-4cb8-b585-2e093388fc8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:19.401724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb5510-2edd-4cb8-b585-2e093388fc8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:19.403090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb5510-2edd-4cb8-b585-2e093388fc8e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:19.413849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 241/480] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:21.152185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25c38-5716-4b5c-8ac9-40e7002772a7 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.153242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25c38-5716-4b5c-8ac9-40e7002772a7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.153800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25c38-5716-4b5c-8ac9-40e7002772a7 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.155772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 240/481] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:21.180285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369583d2-f24e-4649-87b2-0eed50cc2b39 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.181602 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369583d2-f24e-4649-87b2-0eed50cc2b39 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.182271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369583d2-f24e-4649-87b2-0eed50cc2b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.216243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-369583d2-f24e-4649-87b2-0eed50cc2b39 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:21.217849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-369583d2-f24e-4649-87b2-0eed50cc2b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:21.307843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 242/482] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:21.343441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c25c38-5716-4b5c-8ac9-40e7002772a7 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:21.370023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4db6d-663c-42ae-a56e-be9802b3031f None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.370335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4db6d-663c-42ae-a56e-be9802b3031f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.370584 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4db6d-663c-42ae-a56e-be9802b3031f None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.372192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 243/483] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:21.377064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd899c6-78f1-451e-b881-26fabef9750c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.377345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd899c6-78f1-451e-b881-26fabef9750c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.377648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd899c6-78f1-451e-b881-26fabef9750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.394417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5fd899c6-78f1-451e-b881-26fabef9750c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:21.395585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5fd899c6-78f1-451e-b881-26fabef9750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:21.463911 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 244/484] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:21.465116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a53e5-6a81-4f2c-a926-90d6abf5d6d4 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.465390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a53e5-6a81-4f2c-a926-90d6abf5d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.465795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a53e5-6a81-4f2c-a926-90d6abf5d6d4 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.467344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 245/485] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:21.473213 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad151-a489-496f-88e0-5641536cd0da None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.473500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad151-a489-496f-88e0-5641536cd0da None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.473799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fad151-a489-496f-88e0-5641536cd0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.475272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c25c38-5716-4b5c-8ac9-40e7002772a7 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:21.492904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-60fad151-a489-496f-88e0-5641536cd0da None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:21.494115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-60fad151-a489-496f-88e0-5641536cd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:21.524035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b566-11f0-4876-abb0-9ce0263d86fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:21.525166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b566-11f0-4876-abb0-9ce0263d86fe None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.525616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b566-11f0-4876-abb0-9ce0263d86fe None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.526039 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b566-11f0-4876-abb0-9ce0263d86fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.536338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28b566-11f0-4876-abb0-9ce0263d86fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-df28b566-11f0-4876-abb0-9ce0263d86fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:21.544435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:21.545466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:21.546447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:21.553131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 241/486] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:21.554267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b566-11f0-4876-abb0-9ce0263d86fe None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:21.561107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 246/487] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:21.562004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fad151-a489-496f-88e0-5641536cd0da None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:21.653934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b566-11f0-4876-abb0-9ce0263d86fe None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:21.683036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fad151-a489-496f-88e0-5641536cd0da None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:21.686191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c994d9-509a-4879-801a-8935e94ad1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:21.687416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c994d9-509a-4879-801a-8935e94ad1ea None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.687842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c994d9-509a-4879-801a-8935e94ad1ea None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.688266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c994d9-509a-4879-801a-8935e94ad1ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.698972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c994d9-509a-4879-801a-8935e94ad1ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-f3c994d9-509a-4879-801a-8935e94ad1ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:21.707580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:21.708488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:21.709264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:21.716430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 242/488] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:21.717473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c994d9-509a-4879-801a-8935e94ad1ea None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:21.719159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:21.719827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.720109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.720425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.721176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:21.721481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:21.722901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:21.735687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 247/489] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:21.735687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:21.821677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c994d9-509a-4879-801a-8935e94ad1ea None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:21.832880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab11183-3f8b-40c9-bf38-f521002ba5be None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:21.856553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda489b-5d6e-41b0-a275-e645f7a126b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:21.857648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda489b-5d6e-41b0-a275-e645f7a126b2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.858078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda489b-5d6e-41b0-a275-e645f7a126b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.858517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda489b-5d6e-41b0-a275-e645f7a126b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.868805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:21.869729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:21.870153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:21.870264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda489b-5d6e-41b0-a275-e645f7a126b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:21.870685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:21.871582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:21.872275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:21.873851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ebda489b-5d6e-41b0-a275-e645f7a126b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:21.878997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:21.880290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:21.881261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:21.883559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 248/491] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:21.883764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 243/491] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:21.884387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:21.890585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda489b-5d6e-41b0-a275-e645f7a126b2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.006656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185ad9e-f5e3-4a97-b88b-4cb121695310 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.008035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda489b-5d6e-41b0-a275-e645f7a126b2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.043351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.044538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.044964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.045465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.046815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:22.047244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.047437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.048216 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.049109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.049485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.049948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.060121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 244/492] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:22.061588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.062027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.063902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:22.087376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:22.088436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:22.089250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:22.089250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:22.089250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:22.089250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:22.089865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 249/493] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:22.090817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.181464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6dfa-1e19-4fef-909b-3fcf18c3eaf4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.201434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d68df-5b26-4d8c-b91f-201f861641ad None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.214390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.215183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.215469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.215735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.226385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.227823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.234998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc2178-a3cd-41c1-b4bd-5976da505578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.235790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2178-a3cd-41c1-b4bd-5976da505578 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.236867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2178-a3cd-41c1-b4bd-5976da505578 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.237184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc2178-a3cd-41c1-b4bd-5976da505578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:22.245464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:22.246494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:22.247532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:22.247532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:22.247532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:22.247532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:22.248137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc2178-a3cd-41c1-b4bd-5976da505578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.253467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc2178-a3cd-41c1-b4bd-5976da505578 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.253886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 245/494] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:22.254856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-48cc2178-a3cd-41c1-b4bd-5976da505578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:22.266937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:22.267872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:22.268692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:22.268692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:22.268692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:22.268692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:22.268692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 250/495] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:22.269361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b59533-c47e-4ea8-a048-c1c17ade14c7 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.269626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b59533-c47e-4ea8-a048-c1c17ade14c7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.269907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b59533-c47e-4ea8-a048-c1c17ade14c7 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.271161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 251/496] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:22.271839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b59533-c47e-4ea8-a048-c1c17ade14c7 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.352488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f07816-9692-4398-ab25-c5f38a677905 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.370570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b59533-c47e-4ea8-a048-c1c17ade14c7 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.383343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ab479-3868-41b4-ab5b-740b08d8c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.383994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab479-3868-41b4-ab5b-740b08d8c386 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.384274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab479-3868-41b4-ab5b-740b08d8c386 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.384549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab479-3868-41b4-ab5b-740b08d8c386 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.385256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ab479-3868-41b4-ab5b-740b08d8c386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:22.385586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ab479-3868-41b4-ab5b-740b08d8c386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.386938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ab479-3868-41b4-ab5b-740b08d8c386 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.398086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 246/497] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:22.399305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c886-e36d-4ae1-82ee-9e379c70569e None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.399590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c886-e36d-4ae1-82ee-9e379c70569e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.399864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323c886-e36d-4ae1-82ee-9e379c70569e None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.401247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 247/498] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:22.401778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c886-e36d-4ae1-82ee-9e379c70569e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.405784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fad355-f53e-481e-9ec7-7fd0d250d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.406513 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fad355-f53e-481e-9ec7-7fd0d250d155 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.406798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fad355-f53e-481e-9ec7-7fd0d250d155 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.407071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fad355-f53e-481e-9ec7-7fd0d250d155 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.408319 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fad355-f53e-481e-9ec7-7fd0d250d155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:22.408624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fad355-f53e-481e-9ec7-7fd0d250d155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.410022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fad355-f53e-481e-9ec7-7fd0d250d155 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.421327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 252/499] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:22.422595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1446c22-5955-4d53-9c0e-63ae0b87149d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.422884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1446c22-5955-4d53-9c0e-63ae0b87149d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.423156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1446c22-5955-4d53-9c0e-63ae0b87149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.440230 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a1446c22-5955-4d53-9c0e-63ae0b87149d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:22.441404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a1446c22-5955-4d53-9c0e-63ae0b87149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:22.498532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323c886-e36d-4ae1-82ee-9e379c70569e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.505069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 253/500] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:22.505928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1446c22-5955-4d53-9c0e-63ae0b87149d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.543139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e5195-0476-41c2-b50a-0e9487f7ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.543723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e5195-0476-41c2-b50a-0e9487f7ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.544005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e5195-0476-41c2-b50a-0e9487f7ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.544276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e5195-0476-41c2-b50a-0e9487f7ecf3 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.544990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e5195-0476-41c2-b50a-0e9487f7ecf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:22.545295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e5195-0476-41c2-b50a-0e9487f7ecf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.546727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e5195-0476-41c2-b50a-0e9487f7ecf3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.558236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 248/501] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:22.559203 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850f34-da40-4698-a69f-721b0bfc58fc None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.559490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850f34-da40-4698-a69f-721b0bfc58fc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.559765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850f34-da40-4698-a69f-721b0bfc58fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.576228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-3e850f34-da40-4698-a69f-721b0bfc58fc None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:22.577409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3e850f34-da40-4698-a69f-721b0bfc58fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:22.610761 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1446c22-5955-4d53-9c0e-63ae0b87149d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.641706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 249/502] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:22.642604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.643127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e850f34-da40-4698-a69f-721b0bfc58fc None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.643418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.643687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.643980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.653830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.655449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:22.671976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:22.673094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 254/503] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:22.674272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.740901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e850f34-da40-4698-a69f-721b0bfc58fc None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.766939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f051e-7a4e-4f85-8da6-c542f69ff0c6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.773492 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.774314 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.774595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.774861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.781896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.784103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:22.799677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:22.800778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 07:25:22.806580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:22.807197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad0bf-f139-40ca-9e11-13ceac929e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.807197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad0bf-f139-40ca-9e11-13ceac929e4a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.807197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad0bf-f139-40ca-9e11-13ceac929e4a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.807500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 250/504] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:22.807581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ad0bf-f139-40ca-9e11-13ceac929e4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.807658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.811556 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ad0bf-f139-40ca-9e11-13ceac929e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-209ad0bf-f139-40ca-9e11-13ceac929e4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:22.819649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:22.820736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 255/505] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:22.821688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad0bf-f139-40ca-9e11-13ceac929e4a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.900044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de71bb-7e2a-400c-9bb0-ef098a65253a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.919473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ad0bf-f139-40ca-9e11-13ceac929e4a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:22.933514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.934329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.934610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.934883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.942948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.944405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.950995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:22.951774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:22.952056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:22.952329 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:22.959855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:22.960973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 251/506] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:22.966652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:22.967402 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:22.967402 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:22.982719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:22.983718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:22.984759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:22.984759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:22.984759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:22.984759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:22.986847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 256/507] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:22.986847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.062470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313012c-c3b0-4a82-aa7c-36f4fda87302 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.081627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1146e-2c12-445e-ada7-4552169e15c7 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.095904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.096572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.096859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.097132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.098319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:23.098643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.100107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.113347 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.114035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.114315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.114585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.115408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:23.115715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.117139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.138418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 252/508] 10.222.0.36 () {56 vars in 1137 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:23.139609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.155152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 257/509] 10.222.0.36 () {56 vars in 1137 bytes} [Wed May 11 07:25:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:23.155993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.236768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa5fa4-634c-48cc-bbfa-845ca737eccc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.250191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e31bd8-5f32-405e-b74b-2e673c397521 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.271898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.272559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.272840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.273112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.273885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:23.274187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.275566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.283486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.284155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.284442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.284636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 253/510] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:23.284729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.285481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.285595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:23.285857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.287300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.303949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 258/511] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:25:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:23.304771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.379677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614fd17-e0f3-4c0d-b002-a2258bab813e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.397899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096f812-6a01-4104-be45-cd0c75d1f55b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.410444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.411097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.411377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.411656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.412361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:23.412663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.414066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.425486 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 254/512] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:23.426279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.433122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f931152-37f3-4513-b3b2-dfa4dc61a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.433787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931152-37f3-4513-b3b2-dfa4dc61a736 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.434066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931152-37f3-4513-b3b2-dfa4dc61a736 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.434335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f931152-37f3-4513-b3b2-dfa4dc61a736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.502668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f931152-37f3-4513-b3b2-dfa4dc61a736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.504145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f931152-37f3-4513-b3b2-dfa4dc61a736 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.520448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442a02-ac76-4b28-b441-c9764f5a41e0 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.551772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7405981-b837-4473-8f69-0cdc0cc1f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.552418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405981-b837-4473-8f69-0cdc0cc1f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.552702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405981-b837-4473-8f69-0cdc0cc1f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.552982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405981-b837-4473-8f69-0cdc0cc1f1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.594444 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 259/513] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:23.595286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f931152-37f3-4513-b3b2-dfa4dc61a736 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.616037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7405981-b837-4473-8f69-0cdc0cc1f1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.617529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7405981-b837-4473-8f69-0cdc0cc1f1d7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.685314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f931152-37f3-4513-b3b2-dfa4dc61a736 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.708813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 255/514] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:23.709655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7405981-b837-4473-8f69-0cdc0cc1f1d7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.717050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.717864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.718147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.718426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.728489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.729970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:23.748344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:23.749348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:23.750258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:23.750258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:23.750258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:23.750258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:23.750258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 260/515] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:23.750258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.804898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7405981-b837-4473-8f69-0cdc0cc1f1d7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.835684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd8e9b-9cad-46dd-b29a-a33ec3e2e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.836319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd8e9b-9cad-46dd-b29a-a33ec3e2e2af None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.836598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd8e9b-9cad-46dd-b29a-a33ec3e2e2af None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.836866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd8e9b-9cad-46dd-b29a-a33ec3e2e2af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.840298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004bcea-a1ae-46a8-83d2-ea1a25a5562c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:23.872209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2646dc-9429-4faf-ad76-432a349d7dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:23.872850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2646dc-9429-4faf-ad76-432a349d7dc7 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:23.873127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2646dc-9429-4faf-ad76-432a349d7dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:23.873394 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2646dc-9429-4faf-ad76-432a349d7dc7 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:23.874115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2646dc-9429-4faf-ad76-432a349d7dc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.875525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2646dc-9429-4faf-ad76-432a349d7dc7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:23.894336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 261/516] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:25:23 2022] POST /identity/v3/users => generated 247 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:23.895134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2646dc-9429-4faf-ad76-432a349d7dc7 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:23.899153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd8e9b-9cad-46dd-b29a-a33ec3e2e2af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:23.900642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd8e9b-9cad-46dd-b29a-a33ec3e2e2af None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.004216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 256/517] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:24.005909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd8e9b-9cad-46dd-b29a-a33ec3e2e2af None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.007007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2646dc-9429-4faf-ad76-432a349d7dc7 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.044870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.045876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.046254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.046507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.060988 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.062746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:24.081344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:24.082266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:24.084116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:24.084116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:24.084116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:24.084116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:24.084116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 262/518] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:24.084116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.113505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd8e9b-9cad-46dd-b29a-a33ec3e2e2af None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.152599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.153391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.153790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.153969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.164632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.165639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:24.182499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:24.183499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:24.188976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:24.188976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:24.188976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:24.188976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:24.188976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 257/519] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:24.188976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.196961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d264-fcec-402b-98d5-53ad4ef03925 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.230252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.230913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.231191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.231462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.232182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:24.232488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.233874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.249889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 263/520] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:24.249889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.286274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e8782-9f7b-407f-8cf6-67af89bd3fc2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.318844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.319645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.319931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.320209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.331110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.332750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.343570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6ab05-eb58-40d4-addc-c42b469b1a1e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:24.349804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:24.350642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:24.356608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:24.356608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:24.356608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:24.356608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:24.356608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 258/521] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:24.356608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.377023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.377719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.377999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.378283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.379014 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:24.379324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.380715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.396271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 264/522] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:24.396271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.456653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30e206-77c4-4cdf-9585-3a08f78eceeb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.490682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.491349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.491636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.491910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.492630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:24.492950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.494360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.502827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecf95d-66b0-4662-90e0-f12d3b6dc64c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.506528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 259/523] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:24.508294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.536690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.537412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.537736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.538014 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.545500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.546990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:24.560863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:24.561778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:24.562944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 265/524] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:24.564671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.610186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b9a6-07eb-43dd-8cbf-8b015da5d313 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.647800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.648465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.648750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.649027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.649817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:24.650137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.651665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.662624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 260/525] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:24.662624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.669313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09117b42-4a55-4d79-bd56-9440160f7e7e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.701431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d5262-157e-4072-854d-db3df908df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.702328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d5262-157e-4072-854d-db3df908df35 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.702670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d5262-157e-4072-854d-db3df908df35 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.703013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d5262-157e-4072-854d-db3df908df35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.710385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d5262-157e-4072-854d-db3df908df35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.711809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d5262-157e-4072-854d-db3df908df35 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-058d5262-157e-4072-854d-db3df908df35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:24.726137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:24.727162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 266/526] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:24.732999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d5262-157e-4072-854d-db3df908df35 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.762355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eabd7-5bf2-4ea0-aed6-d7e5f9dfbce4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.796967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.797907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.798016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.798293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.804936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.806424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:24.821817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:24.822636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:24.823453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 261/527] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:24.823892 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.835250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d5262-157e-4072-854d-db3df908df35 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.867497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.868167 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.868454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.868719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.869862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:24.870399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.872162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.893938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 267/528] 10.222.0.36 () {56 vars in 1139 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:24.893938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:24.926277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532fdba-c354-4419-a59c-f7d974ef4f8e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.959335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:24.960185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:24.960473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:24.960752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:24.967206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:24.968715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:24.982139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:24.982967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:24.983785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:24.983785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:24.983785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:24.983785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:24.983785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:24.983785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:24.983785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:24.983785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:24.984209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab2f07-4453-438f-9297-6965a27ba257 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:24.988381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 262/529] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:24.989556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:25.022236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.023640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.023931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.024213 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.025001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:25.025316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.026789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.055175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 268/530] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:25.056599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:25.087514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5f6cc-ee1f-48a0-a90f-fc13efdce4db None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:25.120122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.121006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.121436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.121880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.122804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:25.123318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.124955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.143664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 263/531] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:25.144765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:25.159418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f733a33-477f-4b83-8b9a-6e4084f1bddf None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:25.193896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1768-36e6-48b6-b557-5dc91374287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.194716 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1768-36e6-48b6-b557-5dc91374287d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.195090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1768-36e6-48b6-b557-5dc91374287d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.195699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1768-36e6-48b6-b557-5dc91374287d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.243437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01fd81-72d2-40c0-8f2b-aea6308d7a33 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:25.261358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed1768-36e6-48b6-b557-5dc91374287d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.262886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed1768-36e6-48b6-b557-5dc91374287d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.275212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.275872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.276160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.276439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.277222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:25.277571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.278999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.291043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 264/532] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:25.292442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:25.359095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 269/533] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:25.360596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1768-36e6-48b6-b557-5dc91374287d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:25.389482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be82b7-2504-40e3-b6b3-3c4e01e1ed9c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:25.421731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.422502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.422877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.423264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.424697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=91feeca74fe749fba52423aa28d48916) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:25.425119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.426674 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.441893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 265/534] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:25 2022] GET /identity/v3/role_assignments?user.id=91feeca74fe749fba52423aa28d48916&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:25.441893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:25.464194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1768-36e6-48b6-b557-5dc91374287d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:25.504586 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.505345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.505726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.506089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.507002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=529651ab9dd74ee1b50382d03800aea8) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:25.507442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.509042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.515470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 270/535] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:25 2022] GET /identity/v3/role_assignments?user.id=529651ab9dd74ee1b50382d03800aea8&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:25.516418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:25.617910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd66031-8a32-43b5-8401-b13d9bd4fd53 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:25.686312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f637f-6f73-431e-b017-82d7706311fd None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:25.701148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.701969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.702254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.702529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.703382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=d42155dc7b5f42b79943f99952448202) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:25.703950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.705758 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.715477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 266/536] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:25 2022] GET /identity/v3/role_assignments?user.id=d42155dc7b5f42b79943f99952448202&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:25.740887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.741838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.742118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.742387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.755688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.757161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:25.776657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:25.777565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:25.778502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:25.778502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:25.778502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:25.778502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:25.778502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 271/537] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:25.784338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:25.909703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb8799-ce7e-4f91-91ef-2d47dfebcd4b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:25.948948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:25.949654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:25.949929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:25.950198 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:25.950920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:25.951220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:25.952605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:25.965947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 267/538] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:25.974638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:26.104928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e99306-fd26-468f-bcc9-a8fb815866b8 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:26.151673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc214bae-1746-4cb4-ac2b-a3deef45deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:26.152468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214bae-1746-4cb4-ac2b-a3deef45deaf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.152748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214bae-1746-4cb4-ac2b-a3deef45deaf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.153019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc214bae-1746-4cb4-ac2b-a3deef45deaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.164094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc214bae-1746-4cb4-ac2b-a3deef45deaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:26.165832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc214bae-1746-4cb4-ac2b-a3deef45deaf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-bc214bae-1746-4cb4-ac2b-a3deef45deaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:26.180055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:26.180923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:26.181740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:26.181740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:26.181740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:26.181740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:26.181740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:26.181740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:26.181740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:26.181740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:26.184209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 272/539] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:26.190396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:26.225067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75e459-d242-4a08-ad00-e0606d8a1fbe None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.225703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75e459-d242-4a08-ad00-e0606d8a1fbe None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.226174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75e459-d242-4a08-ad00-e0606d8a1fbe None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.227721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 273/540] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:26.232921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ad4a-f4dc-4d8e-9d7b-33e5fc8e890c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.233457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ad4a-f4dc-4d8e-9d7b-33e5fc8e890c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.233986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507ad4a-f4dc-4d8e-9d7b-33e5fc8e890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.250948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7507ad4a-f4dc-4d8e-9d7b-33e5fc8e890c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:26.252938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7507ad4a-f4dc-4d8e-9d7b-33e5fc8e890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:26.308484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048b32-b812-40fb-a077-5d3a21648b34 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:26.347197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:26.347878 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.348164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.348442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.349237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:26.349565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:26.351100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:26.352383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 274/541] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:26.376155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ad4a-f4dc-4d8e-9d7b-33e5fc8e890c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:26.380331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 268/542] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:26.386121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:26.477211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7507ad4a-f4dc-4d8e-9d7b-33e5fc8e890c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:26.512668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe437-103a-4bf0-b214-89b7ff8d7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:26.513902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe437-103a-4bf0-b214-89b7ff8d7cee None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.514489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe437-103a-4bf0-b214-89b7ff8d7cee None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.514991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe437-103a-4bf0-b214-89b7ff8d7cee None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.526286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe437-103a-4bf0-b214-89b7ff8d7cee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5cfbe437-103a-4bf0-b214-89b7ff8d7cee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:26.534594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:26.535472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:26.536222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:26.538921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 275/543] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:26.544693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe437-103a-4bf0-b214-89b7ff8d7cee None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:26.610073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d09c7-01fc-4b20-9518-d9dcae9ebd1d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:26.644432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe437-103a-4bf0-b214-89b7ff8d7cee None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:26.686551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4855-0284-410e-b504-2c467b368012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:26.687783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:26.688722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4855-0284-410e-b504-2c467b368012 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.689813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4855-0284-410e-b504-2c467b368012 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.690608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.691086 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4855-0284-410e-b504-2c467b368012 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.692031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4855-0284-410e-b504-2c467b368012 None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:26.692492 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.692958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.693445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4855-0284-410e-b504-2c467b368012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:26.694467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=66b60e827f404e3891e4f24ca842e5b0) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:26.696054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4855-0284-410e-b504-2c467b368012 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:26.696559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:26.698165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:26.709490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 269/544] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:26 2022] GET /identity/v3/role_assignments?user.id=66b60e827f404e3891e4f24ca842e5b0&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:26.712668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 276/545] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:26.718519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:26.822912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be85bdd-dc0a-4d63-b663-d9fcb90c8c4d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:26.863524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:26.864668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:26.865169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:26.865670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:26.877390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:26.879217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:26.899697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:26.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:26.901454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:26.901454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:26.901454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:26.901454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:26.903992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 270/546] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:26.910766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4855-0284-410e-b504-2c467b368012 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:27.017845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4855-0284-410e-b504-2c467b368012 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:27.053333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:27.054409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:27.054887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:27.055385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:27.056295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:27.056817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:27.058503 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:27.071298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 277/547] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:27.077005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:27.190945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f8071-3d44-4d0b-9078-2cc093a3851d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:27.235073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:27.236310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:27.236782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:27.237241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:27.245193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:27.246889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:27.261322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:27.262232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:27.263078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:27.268226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 271/548] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:27.272089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:27.392437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5c7f0-27d4-4141-b996-ef40b9fb434b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:27.440154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:27.441194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:27.441692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:27.442156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:27.443341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:27.443839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:27.445469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:27.473272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 278/549] 10.222.0.36 () {56 vars in 1135 bytes} [Wed May 11 07:25:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:27.479073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:27.583357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0be22-55cb-4492-affe-2f2e7d0f5cd4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:27.617518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ca978-f74d-4370-a6e8-060533d4d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:27.618620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ca978-f74d-4370-a6e8-060533d4d833 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:27.619095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ca978-f74d-4370-a6e8-060533d4d833 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:27.619581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ca978-f74d-4370-a6e8-060533d4d833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:27.686671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ca978-f74d-4370-a6e8-060533d4d833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:27.688793 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ca978-f74d-4370-a6e8-060533d4d833 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:27.787041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 272/550] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:27.792777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:27.915294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bdc1a-1c86-438c-a2d9-9868ea19ad83 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:27.965128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff5e12-d740-47bb-8407-086ef8fce96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:27.965876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5e12-d740-47bb-8407-086ef8fce96c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:27.966148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5e12-d740-47bb-8407-086ef8fce96c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:27.966417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff5e12-d740-47bb-8407-086ef8fce96c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:27.982171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff5e12-d740-47bb-8407-086ef8fce96c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:27.983632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff5e12-d740-47bb-8407-086ef8fce96c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-bcff5e12-d740-47bb-8407-086ef8fce96c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:28.005467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:28.006349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:28.008153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:28.008153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:28.008153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:28.008153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:28.008153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 279/551] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:28.014364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ca978-f74d-4370-a6e8-060533d4d833 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:28.105576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0b6d5-43f8-4ec6-b24a-06382d049c49 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.105576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0b6d5-43f8-4ec6-b24a-06382d049c49 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.105576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0b6d5-43f8-4ec6-b24a-06382d049c49 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.106330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 280/552] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:28.121390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857997a5-32c8-4bf6-8913-7ed3eb65eb64 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.121726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857997a5-32c8-4bf6-8913-7ed3eb65eb64 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.122013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857997a5-32c8-4bf6-8913-7ed3eb65eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.153204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ca978-f74d-4370-a6e8-060533d4d833 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:28.156522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-857997a5-32c8-4bf6-8913-7ed3eb65eb64 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:28.158342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-857997a5-32c8-4bf6-8913-7ed3eb65eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:28.188610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:28.189345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.189647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.189920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.191133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:28.191445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:28.192907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:28.207446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 273/553] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:28.212902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:28.324286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 281/554] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:28.325026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0961fc7-209d-40d4-9d97-95d2a6609437 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:28.367487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857997a5-32c8-4bf6-8913-7ed3eb65eb64 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:28.381923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fd1f0-3300-4587-a21a-ee417660b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:28.382723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fd1f0-3300-4587-a21a-ee417660b121 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.383049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fd1f0-3300-4587-a21a-ee417660b121 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.383324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fd1f0-3300-4587-a21a-ee417660b121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.390876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fd1f0-3300-4587-a21a-ee417660b121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:28.392885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fd1f0-3300-4587-a21a-ee417660b121 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-524fd1f0-3300-4587-a21a-ee417660b121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:28.411183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:28.412048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:28.412865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:28.412865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:28.412865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:28.412865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:28.412865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:28.412865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:28.412865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:28.412865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:28.413737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 274/555] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:28.414701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ed49-a02a-46bd-8018-52aa51fdb936 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.414988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ed49-a02a-46bd-8018-52aa51fdb936 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.415263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73ed49-a02a-46bd-8018-52aa51fdb936 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.416507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 275/556] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:28.422021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73ed49-a02a-46bd-8018-52aa51fdb936 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:28.487977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857997a5-32c8-4bf6-8913-7ed3eb65eb64 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:28.524918 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824feb2-ccac-4a78-9ac9-771bc559c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:28.525857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824feb2-ccac-4a78-9ac9-771bc559c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.526143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824feb2-ccac-4a78-9ac9-771bc559c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.526420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824feb2-ccac-4a78-9ac9-771bc559c3c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.538765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824feb2-ccac-4a78-9ac9-771bc559c3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:28.541267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73ed49-a02a-46bd-8018-52aa51fdb936 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-2824feb2-ccac-4a78-9ac9-771bc559c3c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:28.547097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:28.549244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 282/557] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:28.551291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb98c-2215-42d9-b181-33a34ca8b888 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.553273 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb98c-2215-42d9-b181-33a34ca8b888 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.553273 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb98c-2215-42d9-b181-33a34ca8b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.570224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-471fb98c-2215-42d9-b181-33a34ca8b888 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:28.571493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-471fb98c-2215-42d9-b181-33a34ca8b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:28.581757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:28.582365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.582701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.582981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.583852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:28.584166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:28.585735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:28.600319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 276/558] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:28.601248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:28.649065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 283/559] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:28.650025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fb98c-2215-42d9-b181-33a34ca8b888 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:28.730393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ec6d-01a1-4309-8b6a-f7761e228d6e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:28.753365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fb98c-2215-42d9-b181-33a34ca8b888 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:28.765977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:28.766646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.766967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.767247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.767993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:28.768307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:28.769708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:28.777720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 277/560] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:28.778584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:28.791384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7842c-064c-411d-86b6-55f9a8338b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:28.792039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7842c-064c-411d-86b6-55f9a8338b6c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.792323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7842c-064c-411d-86b6-55f9a8338b6c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.792598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7842c-064c-411d-86b6-55f9a8338b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.793429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7842c-064c-411d-86b6-55f9a8338b6c None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=0aa4d2cc79404c2c8fbc1ff8868b386a) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:28.793776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7842c-064c-411d-86b6-55f9a8338b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:28.795208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7842c-064c-411d-86b6-55f9a8338b6c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:28.808033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 284/561] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:28 2022] GET /identity/v3/role_assignments?user.id=0aa4d2cc79404c2c8fbc1ff8868b386a&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:28.808033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b09d9-059e-4de1-b54c-fbe2f5a731b2 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.808033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b09d9-059e-4de1-b54c-fbe2f5a731b2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.808033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b09d9-059e-4de1-b54c-fbe2f5a731b2 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.808033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 285/562] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:28.808033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b09d9-059e-4de1-b54c-fbe2f5a731b2 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:28.896568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da8e92-6c35-41d8-b85b-5ee2729d5578 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:28.934801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f44a44-cb42-4736-894b-eadb67de0a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:28.935620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f44a44-cb42-4736-894b-eadb67de0a1c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.935906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f44a44-cb42-4736-894b-eadb67de0a1c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.936193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f44a44-cb42-4736-894b-eadb67de0a1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.946883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b09d9-059e-4de1-b54c-fbe2f5a731b2 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:28.948092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f44a44-cb42-4736-894b-eadb67de0a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-f0f44a44-cb42-4736-894b-eadb67de0a1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:28.956349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:28.957346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:28.958165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:28.962466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 278/563] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:28.963893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d192-5796-47d8-990f-711dc2d17dd3 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.964182 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d192-5796-47d8-990f-711dc2d17dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.964459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2d192-5796-47d8-990f-711dc2d17dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:28.982383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c3a2d192-5796-47d8-990f-711dc2d17dd3 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:28.983588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c3a2d192-5796-47d8-990f-711dc2d17dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:28.991563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:28.993088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:28.993477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:28.993888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.013565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.014172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:29.038383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:29.039485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:29.040677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:29.040677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:29.040677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:29.040677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:29.040677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 286/564] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:29.041004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.071308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 279/565] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:29.072381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2d192-5796-47d8-990f-711dc2d17dd3 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.175629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6441aa-eca1-4745-a5d0-cfaf3ad75445 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.179280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2d192-5796-47d8-990f-711dc2d17dd3 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.212730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.213397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.213731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.214009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.214836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:29.215243 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.216779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.217589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.218532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.218889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.219626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.220913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:29.221226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.222621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.231783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 280/566] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:29.233394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.239899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 287/567] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:29.240762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.338730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70a908-ba0c-4db6-b9ef-8665f8d3dd1f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.346810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a2e7-be26-4777-b674-7e5cd5ebd7e7 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.372915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e16675-6f98-483e-9de0-08a9ba1f767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.373751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16675-6f98-483e-9de0-08a9ba1f767e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.374029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16675-6f98-483e-9de0-08a9ba1f767e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.374307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e16675-6f98-483e-9de0-08a9ba1f767e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.382074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.382876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.383160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.383432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.385215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e16675-6f98-483e-9de0-08a9ba1f767e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:29.391262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.393238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-59e16675-6f98-483e-9de0-08a9ba1f767e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:29.393875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:29.396030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:29.398030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 281/568] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:29.401647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e16675-6f98-483e-9de0-08a9ba1f767e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:29.408433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:29.409568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 07:25:29.410743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:29.414258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 288/569] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:29.415104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.519150 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1beab-a832-4b51-ab20-ebdd66c97420 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.521888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e16675-6f98-483e-9de0-08a9ba1f767e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.553476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.554122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.554411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.554690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.555446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:29.555755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.557129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.559582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.560899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.561326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.561772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.570785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 289/570] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:29.570785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.578948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.581147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:29.599697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:29.600790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:29.602416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:29.602416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:29.602416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:29.602416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:29.604357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 282/571] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:29.605344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.678234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdf4cc-7758-4e26-b3fa-be0b90c5ab2d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.704999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e6cf7-dc1c-48d5-ba44-838872180a5c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.711070 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.711747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.712033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.712315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.713152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:29.713464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.714942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.740746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 290/572] 10.222.0.36 () {56 vars in 1137 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:29.740746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.742390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6a71a-f700-4134-ad5f-40f31e8a8ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.743228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a71a-f700-4134-ad5f-40f31e8a8ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.743514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a71a-f700-4134-ad5f-40f31e8a8ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.743793 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6a71a-f700-4134-ad5f-40f31e8a8ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.755427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6a71a-f700-4134-ad5f-40f31e8a8ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.756887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6a71a-f700-4134-ad5f-40f31e8a8ba4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-92c6a71a-f700-4134-ad5f-40f31e8a8ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:29.774239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:29.775112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:29.776074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:29.776074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:29.776074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:29.776074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:29.776074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 283/573] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:29.776882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3eace-371e-49e6-98b5-cf112c69df81 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.777159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3eace-371e-49e6-98b5-cf112c69df81 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.777427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3eace-371e-49e6-98b5-cf112c69df81 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.778992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 284/574] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:29.783678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3eace-371e-49e6-98b5-cf112c69df81 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.843138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669aa96-a384-4ec5-a212-b38185e907b2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.875458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.876944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.877326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.877639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.878572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:29.878886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.880263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.884362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3eace-371e-49e6-98b5-cf112c69df81 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:29.891311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 291/575] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:29.892756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:29.922853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92af2c-af7e-4b40-84f3-21e82002db01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:29.923671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92af2c-af7e-4b40-84f3-21e82002db01 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.923962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92af2c-af7e-4b40-84f3-21e82002db01 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.924239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92af2c-af7e-4b40-84f3-21e82002db01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.933980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92af2c-af7e-4b40-84f3-21e82002db01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:29.935439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92af2c-af7e-4b40-84f3-21e82002db01 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-0d92af2c-af7e-4b40-84f3-21e82002db01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:29.953361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:29.954996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:29.955974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:29.955974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:29.955974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:29.955974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:29.955974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 285/576] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:29.956471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235564bf-bdbe-4fd5-9b0b-c2f7f6b0f9ab None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:29.956679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235564bf-bdbe-4fd5-9b0b-c2f7f6b0f9ab None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:29.956952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235564bf-bdbe-4fd5-9b0b-c2f7f6b0f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:29.972778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-235564bf-bdbe-4fd5-9b0b-c2f7f6b0f9ab None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:29.973978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-235564bf-bdbe-4fd5-9b0b-c2f7f6b0f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:29.995467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe9ac3-cc4a-4ed0-82fb-4d88fedcb5ee None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.031568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.032224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.032523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.032797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.033512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:30.033847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.035204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.044189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 286/577] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:30.045353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235564bf-bdbe-4fd5-9b0b-c2f7f6b0f9ab None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.056931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 292/578] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:30.058039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.151997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235564bf-bdbe-4fd5-9b0b-c2f7f6b0f9ab None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.156865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b64bb-fe4c-4072-92f2-bf4bea44fa6f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.184415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.185211 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.185489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.185923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.190864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.191519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.191798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.192071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.192783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:30.193087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.193723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.194466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.195191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.209410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 293/579] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:30.209410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:30.209653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:30.210506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 287/580] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:30.211461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.305471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdae3-feac-46e6-a67c-c841996002f4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.309291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde11daa-b6dc-4ef1-9af8-9bd7db5e5e8d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.339071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2466d0-e789-4b24-a3ce-10ae0234fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.339867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2466d0-e789-4b24-a3ce-10ae0234fc7e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.340177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2466d0-e789-4b24-a3ce-10ae0234fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.340418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2466d0-e789-4b24-a3ce-10ae0234fc7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.341275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.342095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.342373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.342646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.350615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.351306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2466d0-e789-4b24-a3ce-10ae0234fc7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:30.352044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ae2466d0-e789-4b24-a3ce-10ae0234fc7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:30.359037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:30.359911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:30.360809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 288/581] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:30.361470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2466d0-e789-4b24-a3ce-10ae0234fc7e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:30.371228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:30.372153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:30.373054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 294/582] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:30.373647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.469622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2466d0-e789-4b24-a3ce-10ae0234fc7e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.492187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff79c8d-69db-410f-a8e5-acc34792811f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.503953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.504754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.505046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.505322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.512015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.513453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.525117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.525812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.526097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.526368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.527226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:30.527543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:30.528091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:30.528902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:30.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:30.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:30.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:30.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:30.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:30.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:30.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:30.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:30.530318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.534138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 289/583] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:30.534995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.550532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 295/584] 10.222.0.36 () {56 vars in 1137 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:30.550532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.635118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc77ee-2751-442b-a6a1-24070718591f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.641532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb4b2-7ca5-45a6-aca8-05c10563bc5e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.669984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.670655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.670941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.671232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.672276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:30.672648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.674079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.677497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.678198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.678481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.678752 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.679582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:30.679889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.681300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.686789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 290/585] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:30.686789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.699419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 296/586] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:30.700234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.797423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b9d7-5482-4750-9a4d-77e013dc4e05 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.804826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade482e-a88a-4ab0-a367-5f94e64f9981 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.832578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.833529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.833835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.834419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.839157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.839907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.840208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.840461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:30.841368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:30.841706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.843247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.845458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:30.847417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:30.855138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 291/587] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:30.855935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:30.874251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:30.875242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:30.876132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:30.876132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:30.876132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:30.876132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:30.876132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 297/588] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:30.877723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:30.961196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6772fba-6491-494b-a0a2-4042df4d5ad0 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.976743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fcae0-56f7-4641-8184-799335715a26 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:30.995188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:30.995975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:30.996253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:30.996518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.006838 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.008275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.011048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.011846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.012130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.012407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.022244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.023688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:31.025367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:31.026376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:31.027221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:31.027221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:31.027221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:31.027221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:31.027221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 292/589] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:31.027509 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:31.046536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:31.047433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:31.048847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:31.048847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:31.048847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:31.048847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:31.052751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 298/590] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:31.053470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.127241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5717ed-b5c4-4817-a607-e8f0130649cc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.148778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836c74-e52b-4698-a36d-3bddebe2b121 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.158054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045e10f-9fec-4cc7-a8ef-038c8db13575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.158935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045e10f-9fec-4cc7-a8ef-038c8db13575 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.159210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045e10f-9fec-4cc7-a8ef-038c8db13575 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.159477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045e10f-9fec-4cc7-a8ef-038c8db13575 None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/529651ab9dd74ee1b50382d03800aea8/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.172785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045e10f-9fec-4cc7-a8ef-038c8db13575 None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=529651ab9dd74ee1b50382d03800aea8, role_id=e09b4b74a6aa4b7a9dc344a03e5c9c35)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.174821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045e10f-9fec-4cc7-a8ef-038c8db13575 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.180936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.181622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.181916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.182209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.182944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:31.183243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.184593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.187696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 293/591] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:25:31 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/529651ab9dd74ee1b50382d03800aea8/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:31.188503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045e10f-9fec-4cc7-a8ef-038c8db13575 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.202301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 299/592] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:31.202301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.296455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045e10f-9fec-4cc7-a8ef-038c8db13575 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.307216 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7326dae-287d-4a3e-ba94-14d9609186e2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.332587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be934d-5302-4520-8783-3549e6f3f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.333266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be934d-5302-4520-8783-3549e6f3f793 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.333565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be934d-5302-4520-8783-3549e6f3f793 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.333850 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be934d-5302-4520-8783-3549e6f3f793 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.334639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be934d-5302-4520-8783-3549e6f3f793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:31.334947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be934d-5302-4520-8783-3549e6f3f793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.336387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be934d-5302-4520-8783-3549e6f3f793 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.341464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.342173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.342454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.342732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.343465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:31.343765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.345948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.354079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 294/593] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:31.354079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74ac0-073b-4bb9-9fd7-4254fc5d7de8 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.354079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74ac0-073b-4bb9-9fd7-4254fc5d7de8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.354079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74ac0-073b-4bb9-9fd7-4254fc5d7de8 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.354079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 295/594] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:31.354079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74ac0-073b-4bb9-9fd7-4254fc5d7de8 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.363683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 300/595] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:31.363683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.460078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74ac0-073b-4bb9-9fd7-4254fc5d7de8 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.462748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c400e7-68f4-456d-97e5-7a3dd87ccfb9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.492967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420692-bef6-45b7-ac31-4fb8141d3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.493819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420692-bef6-45b7-ac31-4fb8141d3f04 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.494094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420692-bef6-45b7-ac31-4fb8141d3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.494347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420692-bef6-45b7-ac31-4fb8141d3f04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.497367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.498413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.498898 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.499386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.500991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420692-bef6-45b7-ac31-4fb8141d3f04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.503077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420692-bef6-45b7-ac31-4fb8141d3f04 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.507293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.508762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-8b420692-bef6-45b7-ac31-4fb8141d3f04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:31.516553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:31.518218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:31.519641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 296/596] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:31.520126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73947fb-a147-4cdf-b23d-728d2d858d70 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.520126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73947fb-a147-4cdf-b23d-728d2d858d70 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.520433 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73947fb-a147-4cdf-b23d-728d2d858d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:31.524030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:31.524938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 301/597] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:31.526294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.540511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a73947fb-a147-4cdf-b23d-728d2d858d70 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:31.541737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a73947fb-a147-4cdf-b23d-728d2d858d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:31.617639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 297/598] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:31.617639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73947fb-a147-4cdf-b23d-728d2d858d70 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.624971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2117d-8858-437c-a21d-c147daac61f7 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.658009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.658798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.659076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.659345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.665770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.667205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:31.681252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:31.682479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 302/599] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:31.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.716195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73947fb-a147-4cdf-b23d-728d2d858d70 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.748718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.749377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.749692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.749967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.750752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:31.751059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.753037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.769092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 298/600] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:31.769724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.780248 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36379c-fcb3-4d48-972c-22ea08372f91 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.813094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.814345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.814646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.814905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.815742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:31.816051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.817481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:31.834261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 303/601] 10.222.0.36 () {56 vars in 1139 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:31.835164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.871640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b5a83-87ef-4d4f-a396-f0d472cfcaea None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.904393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7a2a4-302d-4721-a271-7e688e4b5969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.905190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7a2a4-302d-4721-a271-7e688e4b5969 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.905472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7a2a4-302d-4721-a271-7e688e4b5969 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.905773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7a2a4-302d-4721-a271-7e688e4b5969 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.916386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7a2a4-302d-4721-a271-7e688e4b5969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-adb7a2a4-302d-4721-a271-7e688e4b5969 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:31.924743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:31.925930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 299/602] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:31.927196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7a2a4-302d-4721-a271-7e688e4b5969 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:31.947696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbfde2-a1f7-4697-b39a-eae21bb5c8f6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:31.981035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:31.981720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:31.982006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:31.982284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:31.983089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:31.983401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:31.984816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.001121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 304/603] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:32.001121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.028866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7a2a4-302d-4721-a271-7e688e4b5969 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.062958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0815-acc4-48bf-8ebc-1799a2de071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.063873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0815-acc4-48bf-8ebc-1799a2de071a None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.064155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0815-acc4-48bf-8ebc-1799a2de071a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.064425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0815-acc4-48bf-8ebc-1799a2de071a None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/91feeca74fe749fba52423aa28d48916/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.078200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0815-acc4-48bf-8ebc-1799a2de071a None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=91feeca74fe749fba52423aa28d48916, role_id=e09b4b74a6aa4b7a9dc344a03e5c9c35)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.080016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0815-acc4-48bf-8ebc-1799a2de071a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.101848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 300/604] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:25:31 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/91feeca74fe749fba52423aa28d48916/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:32.101848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0815-acc4-48bf-8ebc-1799a2de071a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.116465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdd084-cb1c-427f-b64e-553edcacabed None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.155444 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.156431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.156783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.158065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.172904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.175818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:32.200395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:32.201361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:32.202267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:32.202267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:32.202267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:32.202267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:32.202636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 305/605] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:32.203813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.219439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0815-acc4-48bf-8ebc-1799a2de071a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.256005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.256987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.257423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.257863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.258767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:32.259244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.260811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.270391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 301/606] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:32.271511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.326419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3c51-f93f-42c4-825c-99add2027220 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.361633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a629d-7d85-4a45-b182-d68df9df0cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.362543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a629d-7d85-4a45-b182-d68df9df0cf6 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.362829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a629d-7d85-4a45-b182-d68df9df0cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.363098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a629d-7d85-4a45-b182-d68df9df0cf6 None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/d42155dc7b5f42b79943f99952448202/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.378143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a629d-7d85-4a45-b182-d68df9df0cf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=d42155dc7b5f42b79943f99952448202, role_id=e09b4b74a6aa4b7a9dc344a03e5c9c35)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.378331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ca689-cc6f-4614-b6b6-2d3e1869f21b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.379599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a629d-7d85-4a45-b182-d68df9df0cf6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.396152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 306/607] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:25:32 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/d42155dc7b5f42b79943f99952448202/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:32.396986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a629d-7d85-4a45-b182-d68df9df0cf6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.430508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.431501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.431930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.432361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.433240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:32.433717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.435259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.456356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 302/608] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:32.464045 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.508133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a629d-7d85-4a45-b182-d68df9df0cf6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.554469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.555316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.555601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.555877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.582879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.584553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.593608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14ba0a-19c9-43b7-a6ae-54b7134952f5 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:32.612488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:32.613653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:32.614751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:32.614751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:32.614751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:32.614751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:32.621102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 307/609] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:32.626722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.634359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.635430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.635860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.636311 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.644631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.646353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:32.660704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:32.661883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:32.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:32.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:32.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:32.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:32.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:32.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:32.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:32.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:32.665004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 303/610] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:32.670704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.772568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf64a0-8a67-4645-ac60-5d9266ca5b7e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.776051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07660c69-6c53-4781-bf12-1ef02b46c457 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.808515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.809168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.809452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.809756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.810493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:32.810786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.811952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:32.812145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.813168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:32.813626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:32.814078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:32.814999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:32.815453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:32.817041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:32.829568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 304/611] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:32.833084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 308/612] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:32.838562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.838899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:32.937783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705bf51-20e0-4f9c-a252-76c610057177 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:32.992672 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ccb7e-299e-47ae-ad18-aba404318616 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:33.014365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f049c9-7c78-4933-81e4-d32f5b3e4975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:33.015261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f049c9-7c78-4933-81e4-d32f5b3e4975 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:33.015537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f049c9-7c78-4933-81e4-d32f5b3e4975 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:33.015813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f049c9-7c78-4933-81e4-d32f5b3e4975 None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/66b60e827f404e3891e4f24ca842e5b0/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:33.041891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f049c9-7c78-4933-81e4-d32f5b3e4975 None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=66b60e827f404e3891e4f24ca842e5b0, role_id=e09b4b74a6aa4b7a9dc344a03e5c9c35)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:33.043254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f049c9-7c78-4933-81e4-d32f5b3e4975 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:33.046684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:33.047483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:33.047759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:33.048091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:33.057937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:33.059742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:33.070826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 305/613] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:25:32 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/66b60e827f404e3891e4f24ca842e5b0/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:33.082829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:33.083854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:33.084771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 309/614] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:33.089834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f049c9-7c78-4933-81e4-d32f5b3e4975 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:33.223625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f049c9-7c78-4933-81e4-d32f5b3e4975 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:33.270715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:33.271400 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:33.271685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:33.271969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:33.272802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:33.273111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:33.274573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:33.293437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 306/615] 10.222.0.36 () {56 vars in 1135 bytes} [Wed May 11 07:25:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:33.298917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:33.408821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1061262-205d-4efe-bb50-731bdad24262 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:33.449036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:33.449869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:33.450158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:33.450436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:33.462206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:33.463675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:33.491973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:33.492897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:33.494257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:33.494257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:33.494257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:33.494257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:33.494257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 310/616] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:33.499057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:33.607942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f4778-9d13-4374-9aed-c07ba57a29ed None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:33.653153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e768a37-5155-435e-92ba-6d03b1ec4319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:33.653866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e768a37-5155-435e-92ba-6d03b1ec4319 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:33.654151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e768a37-5155-435e-92ba-6d03b1ec4319 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:33.654426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e768a37-5155-435e-92ba-6d03b1ec4319 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:33.655166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e768a37-5155-435e-92ba-6d03b1ec4319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:33.655473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e768a37-5155-435e-92ba-6d03b1ec4319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:33.656845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e768a37-5155-435e-92ba-6d03b1ec4319 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:33.672581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 307/617] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:33.678314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:33.799487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7caa1-2892-4ce0-abb2-fca2b891bb57 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:33.799997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7caa1-2892-4ce0-abb2-fca2b891bb57 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:33.800076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7caa1-2892-4ce0-abb2-fca2b891bb57 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:33.805237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 308/618] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:33.808054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562015-9f85-4c51-8714-e6b14510fc51 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:33.808546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562015-9f85-4c51-8714-e6b14510fc51 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:33.809027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562015-9f85-4c51-8714-e6b14510fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:33.812064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a60751-90b3-48d4-80b2-6768e92e4e59 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:33.850089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-57562015-9f85-4c51-8714-e6b14510fc51 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:33.852468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-57562015-9f85-4c51-8714-e6b14510fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:33.858194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:33.859252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:33.859737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:33.860229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:33.874135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:33.875888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:33.894198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:33.895141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:33.896001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:33.896001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:33.896001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:33.896001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:33.896001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:33.896001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:33.896001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:33.896001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:33.898641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 311/619] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:33.903971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:33.988466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 309/620] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:34.018548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57562015-9f85-4c51-8714-e6b14510fc51 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:34.042695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d6a68-b315-4ca6-831d-5bef1122505d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:34.082517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:34.083183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:34.083467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:34.083742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:34.084532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:34.084847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:34.086317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:34.108148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 312/621] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:34.118639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:34.183701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57562015-9f85-4c51-8714-e6b14510fc51 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:34.241613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6866d9-7012-4405-a1d7-aafcc632b42c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:34.267188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db439eb-e641-4b74-8e8c-e81b35053aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:34.268005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db439eb-e641-4b74-8e8c-e81b35053aef None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:34.268286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db439eb-e641-4b74-8e8c-e81b35053aef None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:34.268554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db439eb-e641-4b74-8e8c-e81b35053aef None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:34.276256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d65316-f36e-41ea-a559-2f1d4bb74a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:34.277205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d65316-f36e-41ea-a559-2f1d4bb74a36 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:34.277494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d65316-f36e-41ea-a559-2f1d4bb74a36 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:34.277823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d65316-f36e-41ea-a559-2f1d4bb74a36 None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/0aa4d2cc79404c2c8fbc1ff8868b386a/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:34.284876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db439eb-e641-4b74-8e8c-e81b35053aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-3db439eb-e641-4b74-8e8c-e81b35053aef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:34.292888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:34.293849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:34.295054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 310/622] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:34.302521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db439eb-e641-4b74-8e8c-e81b35053aef None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:34.303696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d65316-f36e-41ea-a559-2f1d4bb74a36 None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=0aa4d2cc79404c2c8fbc1ff8868b386a, role_id=e09b4b74a6aa4b7a9dc344a03e5c9c35)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:34.305145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d65316-f36e-41ea-a559-2f1d4bb74a36 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:34.327943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 313/623] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:25:34 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/0aa4d2cc79404c2c8fbc1ff8868b386a/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:34.438052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db439eb-e641-4b74-8e8c-e81b35053aef None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:34.498344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:34.499043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:34.499331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:34.499609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:34.500380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:34.500694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:34.502708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:34.516364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 311/624] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:34.522748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d65316-f36e-41ea-a559-2f1d4bb74a36 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:34.644138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d65316-f36e-41ea-a559-2f1d4bb74a36 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:34.679743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:34.680542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:34.680824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:34.681098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:34.692045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:34.693439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:34.711288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:34.712226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:34.713695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:34.713695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:34.713695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:34.713695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:34.713695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 314/625] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:34.719610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:34.838750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317cb8b-c3cd-4ca3-8251-3fe88664164c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:34.887894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4597858-8e49-4a27-a1df-3cdad82c7eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:34.889037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597858-8e49-4a27-a1df-3cdad82c7eff None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:34.889037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597858-8e49-4a27-a1df-3cdad82c7eff None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:34.889339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4597858-8e49-4a27-a1df-3cdad82c7eff None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:34.889860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4597858-8e49-4a27-a1df-3cdad82c7eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:34.890172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4597858-8e49-4a27-a1df-3cdad82c7eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:34.891644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4597858-8e49-4a27-a1df-3cdad82c7eff None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:34.907430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 312/626] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:34.913303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:35.045260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173a9a-0d11-4f46-bef1-1e028c5fc6fa None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:35.093587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:35.093587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.094060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85e93-67bc-4610-bc89-03487704dbdf None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.094243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.094395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85e93-67bc-4610-bc89-03487704dbdf None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.094563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.094712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f85e93-67bc-4610-bc89-03487704dbdf None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.097322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 313/627] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:35.101678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d9e37-a750-43b4-b210-8895d25cb33d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.102218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d9e37-a750-43b4-b210-8895d25cb33d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.102719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d9e37-a750-43b4-b210-8895d25cb33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.104681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:35.106173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:35.125003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:35.126034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:35.127722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 315/628] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:35.130495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-245d9e37-a750-43b4-b210-8895d25cb33d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:35.131687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-245d9e37-a750-43b4-b210-8895d25cb33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:35.134080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:35.255546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 314/629] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:35.257008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b149e-3b34-440c-ad75-bd34ef024f4c None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.257305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b149e-3b34-440c-ad75-bd34ef024f4c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.257607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b149e-3b34-440c-ad75-bd34ef024f4c None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.263160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 315/630] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:35.264349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94a14-e8a4-4b1e-9f78-52fbd2b5ee6f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.264645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94a14-e8a4-4b1e-9f78-52fbd2b5ee6f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.264923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94a14-e8a4-4b1e-9f78-52fbd2b5ee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.282906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-95f94a14-e8a4-4b1e-9f78-52fbd2b5ee6f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:35.284144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-95f94a14-e8a4-4b1e-9f78-52fbd2b5ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:35.289849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea78a-cd99-43cb-bcab-9b47b253ee89 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:35.332631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:35.334266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.334776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.335255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.336668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:35.337488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:35.339617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:35.362877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 316/632] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:35.363087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 316/632] 10.222.0.36 () {56 vars in 1137 bytes} [Wed May 11 07:25:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:35.366004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:35.369616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f94a14-e8a4-4b1e-9f78-52fbd2b5ee6f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:35.475166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f94a14-e8a4-4b1e-9f78-52fbd2b5ee6f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:35.495130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56716946-4f21-4a39-a387-28fe06b21d79 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:35.517667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0aa39-84c8-462f-8883-d156a552e71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:35.518321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0aa39-84c8-462f-8883-d156a552e71d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.518601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0aa39-84c8-462f-8883-d156a552e71d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.518869 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0aa39-84c8-462f-8883-d156a552e71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.531978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f9c9-3e9e-4a2f-a1fe-dced579b2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:35.533158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f9c9-3e9e-4a2f-a1fe-dced579b2bb6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.533930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f9c9-3e9e-4a2f-a1fe-dced579b2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.534543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777f9c9-3e9e-4a2f-a1fe-dced579b2bb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.551114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777f9c9-3e9e-4a2f-a1fe-dced579b2bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-7777f9c9-3e9e-4a2f-a1fe-dced579b2bb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:35.559368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:35.560671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:35.562932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:35.566540 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 317/633] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:35.567640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f9c9-3e9e-4a2f-a1fe-dced579b2bb6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:35.602133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0aa39-84c8-462f-8883-d156a552e71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:35.604267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0aa39-84c8-462f-8883-d156a552e71d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:35.674051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777f9c9-3e9e-4a2f-a1fe-dced579b2bb6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:35.707071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2e093-f6c6-4935-b6e2-6caa2228741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:35.708637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2e093-f6c6-4935-b6e2-6caa2228741b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.709203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2e093-f6c6-4935-b6e2-6caa2228741b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.709706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2e093-f6c6-4935-b6e2-6caa2228741b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.716224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 317/634] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:35.717238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0aa39-84c8-462f-8883-d156a552e71d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:35.721060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2e093-f6c6-4935-b6e2-6caa2228741b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-27f2e093-f6c6-4935-b6e2-6caa2228741b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:35.729192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:35.730214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:35.731045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:35.734728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 318/635] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:35.736403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2e093-f6c6-4935-b6e2-6caa2228741b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:35.841158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2e093-f6c6-4935-b6e2-6caa2228741b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:35.846566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0aa39-84c8-462f-8883-d156a552e71d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:35.877337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:35.878082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.878368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.878642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.887386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:35.888194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:35.888604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:35.888878 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:35.889084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:35.889647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:35.889960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:35.890504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:35.891300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:35.901589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 318/636] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:35.902445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:35.908313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:35.909221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:35.910136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:35.910136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:35.910136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:35.910136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:35.910136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 319/637] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:35.911736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.004846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b78dd-8abb-445b-a55e-686677228bd5 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.017904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e67e3f-81b9-4c5b-8102-a535319b735c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.037789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.038457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.038740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.039016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.039755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:36.040064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.041431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.049643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 319/638] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:36.050420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.054746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3269ec-3dc3-484f-b02a-5ebd17f82f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.055589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3269ec-3dc3-484f-b02a-5ebd17f82f67 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.055881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3269ec-3dc3-484f-b02a-5ebd17f82f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.056156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3269ec-3dc3-484f-b02a-5ebd17f82f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.066764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3269ec-3dc3-484f-b02a-5ebd17f82f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.068188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3269ec-3dc3-484f-b02a-5ebd17f82f67 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-ca3269ec-3dc3-484f-b02a-5ebd17f82f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:36.084985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:36.085894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:36.086780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:36.086780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:36.086780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:36.086780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:36.086780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 320/639] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:36.087492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538eed-7fe7-40c9-a32f-7f640839f9e2 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.087651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538eed-7fe7-40c9-a32f-7f640839f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.087901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf538eed-7fe7-40c9-a32f-7f640839f9e2 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.089246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 321/640] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:36.093453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf538eed-7fe7-40c9-a32f-7f640839f9e2 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.158312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4262b8-1aa8-4c6c-9c7a-f437f965eb46 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.189947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.190523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf538eed-7fe7-40c9-a32f-7f640839f9e2 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.190646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.190869 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.191144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.191867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:36.192172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.193565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.205238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 320/641] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:36.206091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.230884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01408bd0-5a24-4c1d-881b-5af18d0d080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.232083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408bd0-5a24-4c1d-881b-5af18d0d080a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.232524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408bd0-5a24-4c1d-881b-5af18d0d080a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.232960 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01408bd0-5a24-4c1d-881b-5af18d0d080a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.243290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01408bd0-5a24-4c1d-881b-5af18d0d080a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.244897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01408bd0-5a24-4c1d-881b-5af18d0d080a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-01408bd0-5a24-4c1d-881b-5af18d0d080a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:36.261779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:36.262943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:36.264091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:36.264091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:36.264091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:36.264091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:36.265625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 322/642] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:36.267549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd811f-2b1c-49ca-86ec-588c655f3dbc None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.267977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd811f-2b1c-49ca-86ec-588c655f3dbc None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.268382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd811f-2b1c-49ca-86ec-588c655f3dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.285689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-bbdd811f-2b1c-49ca-86ec-588c655f3dbc None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:36.287089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-bbdd811f-2b1c-49ca-86ec-588c655f3dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:36.300937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e273c-9385-4ae2-8ee5-0a813fe98449 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.334151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.334806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.335225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.335499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.336211 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:36.336515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.337902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.349376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 321/643] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:36.350202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.365690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 323/644] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:36.366752 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd811f-2b1c-49ca-86ec-588c655f3dbc None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.444617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf65dd-77cb-4d04-97f1-1da1db4018ee None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.469678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd811f-2b1c-49ca-86ec-588c655f3dbc None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.477995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.478826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.479115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.479394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.486407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.487860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:36.502583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:36.503493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:36.504455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 322/645] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:36.504972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.510640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.511305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.511587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.511857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.512604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:36.512910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.514296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.525952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 324/646] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:36.530541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.615057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489b4a2-d277-4465-ade5-a8fd6b95ee92 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.627803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83878d62-e044-4af4-8716-5bc19f0c9c70 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.650278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.651056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.651337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.651610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.658566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.660006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.660892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5621-067e-43c2-82ad-69af5b6ae93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.661715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5621-067e-43c2-82ad-69af5b6ae93d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.661996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5621-067e-43c2-82ad-69af5b6ae93d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.662267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5621-067e-43c2-82ad-69af5b6ae93d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.671971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b5621-067e-43c2-82ad-69af5b6ae93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:36.674523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:36.675418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 07:25:36.676363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:36.677870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 323/647] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:36.678942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-128b5621-067e-43c2-82ad-69af5b6ae93d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:36.679750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:36.680641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:36.681452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 325/648] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:36.682719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5621-067e-43c2-82ad-69af5b6ae93d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.783444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300041-8f0c-4384-8c19-22fd4b619069 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.785758 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5621-067e-43c2-82ad-69af5b6ae93d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.816674 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.817684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.817836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.818115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.818387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.818622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.818906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.819165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:36.819260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.819472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.820884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.826870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.828298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.837559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 324/649] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:36.837559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:36.843243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:36.844209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:36.845187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 326/650] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:36.845830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:36.946113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ccb33-54eb-436f-90bc-7dca1d919029 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.948823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e07b-6def-4a53-8a99-6f158b63b9e2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:36.977552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.978229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.978508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.978776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.979507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:36.979808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.980426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:36.981082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:36.981173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.981367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:36.981677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:36.982505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:36.982816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:36.984245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:36.989154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 327/651] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:36.989949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.002274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 325/652] 10.222.0.36 () {56 vars in 1137 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:37.003095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.085562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ed8a5-516e-4c11-a344-b06d5948ec0d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:37.094000 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9938c-f4fc-4c87-b7dd-a4e5b5edfb42 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:37.116240 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7560bf-fdc8-4e4b-a526-948abc54dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:37.116876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7560bf-fdc8-4e4b-a526-948abc54dc26 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.117157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7560bf-fdc8-4e4b-a526-948abc54dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.117429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7560bf-fdc8-4e4b-a526-948abc54dc26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.118270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7560bf-fdc8-4e4b-a526-948abc54dc26 None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=529651ab9dd74ee1b50382d03800aea8) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:37.118582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7560bf-fdc8-4e4b-a526-948abc54dc26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:37.119986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7560bf-fdc8-4e4b-a526-948abc54dc26 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:37.125462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 328/653] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:36 2022] GET /identity/v3/role_assignments?user.id=529651ab9dd74ee1b50382d03800aea8&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:37.125614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:37.126694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.126986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.127208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132491b-95da-48bc-bc35-5a5482962653 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.127308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.127493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132491b-95da-48bc-bc35-5a5482962653 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.127765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132491b-95da-48bc-bc35-5a5482962653 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.128060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:37.128367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:37.133149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 329/654] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:37.133337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:37.133461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132491b-95da-48bc-bc35-5a5482962653 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.148889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 326/655] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:37.149630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.253693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f69bac-8892-4713-97b0-fc3e83837dfe None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:37.257893 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132491b-95da-48bc-bc35-5a5482962653 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:37.289684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40267b6-2b25-4fee-8cc3-4a7e9ecc0975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:37.290348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40267b6-2b25-4fee-8cc3-4a7e9ecc0975 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.290628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40267b6-2b25-4fee-8cc3-4a7e9ecc0975 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.290905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40267b6-2b25-4fee-8cc3-4a7e9ecc0975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.292188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514dba99-dd64-4ae6-9cbd-a0752d35ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:37.292984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dba99-dd64-4ae6-9cbd-a0752d35ff3c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.293264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dba99-dd64-4ae6-9cbd-a0752d35ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.293574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dba99-dd64-4ae6-9cbd-a0752d35ff3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.305036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dba99-dd64-4ae6-9cbd-a0752d35ff3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:37.306523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514dba99-dd64-4ae6-9cbd-a0752d35ff3c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-514dba99-dd64-4ae6-9cbd-a0752d35ff3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:37.324550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:37.325457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:37.326493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:37.326493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:37.326493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:37.326493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:37.331132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 330/656] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:37.332398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705571-bda5-4e4b-83de-d2c4bcfd5faf None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.332683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705571-bda5-4e4b-83de-d2c4bcfd5faf None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.332954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705571-bda5-4e4b-83de-d2c4bcfd5faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.352722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8d705571-bda5-4e4b-83de-d2c4bcfd5faf None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:37.354192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8d705571-bda5-4e4b-83de-d2c4bcfd5faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:37.363091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40267b6-2b25-4fee-8cc3-4a7e9ecc0975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:37.364557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40267b6-2b25-4fee-8cc3-4a7e9ecc0975 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:37.429567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 331/657] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:37.429567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705571-bda5-4e4b-83de-d2c4bcfd5faf None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.465865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 327/658] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:37.465865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40267b6-2b25-4fee-8cc3-4a7e9ecc0975 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.539663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705571-bda5-4e4b-83de-d2c4bcfd5faf None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:37.556414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40267b6-2b25-4fee-8cc3-4a7e9ecc0975 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:37.572342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691271f8-8535-4635-8e5b-d45c6d5a1974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:37.572990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691271f8-8535-4635-8e5b-d45c6d5a1974 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.573272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691271f8-8535-4635-8e5b-d45c6d5a1974 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.573627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691271f8-8535-4635-8e5b-d45c6d5a1974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.588798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:37.589452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.589753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.590023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.590729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:37.591032 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:37.592378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:37.608141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 328/659] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:37.608946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.638257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691271f8-8535-4635-8e5b-d45c6d5a1974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:37.639728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691271f8-8535-4635-8e5b-d45c6d5a1974 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:37.704935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7b841-7891-48df-956e-988f75e0bf52 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:37.737513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf435c-98ba-4aa4-af65-c5e89518e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:37.738422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf435c-98ba-4aa4-af65-c5e89518e556 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.738866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf435c-98ba-4aa4-af65-c5e89518e556 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.738974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf435c-98ba-4aa4-af65-c5e89518e556 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.746383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 332/660] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:37.746383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691271f8-8535-4635-8e5b-d45c6d5a1974 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.751517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf435c-98ba-4aa4-af65-c5e89518e556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-3bdf435c-98ba-4aa4-af65-c5e89518e556 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:37.759309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:37.760436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:37.761505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:37.765192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 329/661] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:37.765919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf435c-98ba-4aa4-af65-c5e89518e556 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.839784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691271f8-8535-4635-8e5b-d45c6d5a1974 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:37.876052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:37.876776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:37.877061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:37.877338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:37.888434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:37.889962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:37.910852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:37.911852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:37.912715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:37.912715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:37.912715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:37.912715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:37.916960 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 333/662] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:37.917831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:37.993691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf435c-98ba-4aa4-af65-c5e89518e556 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.021941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebc466-5b73-412c-b738-58ab96007ef6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.031704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.033142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.033421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.033724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.042538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.044445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.053657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.054436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.054715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.054986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:38.060565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:38.061461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:38.062691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 330/663] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:38.068680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.068793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.068793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:38.086469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:38.087423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:38.088289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:38.088289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:38.088289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:38.088289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:38.088856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 334/664] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:38.092832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.170702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c309550-0c8a-482f-b545-4441c70fab66 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.185972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806958-4fb6-4a8d-8e69-007ab2da5669 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.207205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.208137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.208430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.209355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.210262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:38.210262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.211286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.219624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 331/665] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:38.220613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.226384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.227233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.227665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.228075 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.228930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:38.229386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.230913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.246512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 335/666] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:38.246512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.319764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0070-8ae4-49c9-9d91-fabe6e785534 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.343437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79959af6-2949-4139-a10f-cfe09a119b1b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.352691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.353365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.353680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.354032 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.354778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:38.355089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.356514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.374576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 332/667] 10.222.0.36 () {56 vars in 1139 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:38.375815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.376736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.377533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.377870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.378222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.379021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:38.379484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.380973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.393141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 336/668] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:38.394159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.475457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e663a2-9af1-46a7-989d-8c650d1fda93 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.492025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3a0fd-e3a0-4774-a628-a41b361c6064 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.508355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.509173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.509452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.509745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.519159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.520597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.524033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.524813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.525089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.525358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.531777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.533221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:38.537192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:38.538309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:38.539187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:38.539187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:38.539187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:38.539187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:38.543021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 333/669] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:38.543579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:38.546456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:38.547293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 337/670] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:38.549508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.641304 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa61436-4955-4359-8ba9-ee4fdb240681 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.642220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259bf96-dd99-49ab-aec6-8e95a6af8c41 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.674513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad0524-8105-457f-8431-6d413f33a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.674713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.675151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad0524-8105-457f-8431-6d413f33a109 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.675326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.675429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad0524-8105-457f-8431-6d413f33a109 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.675577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.675668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad0524-8105-457f-8431-6d413f33a109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.675844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.682471 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.683930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:38.698832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:38.699723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:38.700599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:38.700599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:38.700599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:38.700599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:38.700599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:38.700599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:38.700599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:38.700599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:38.701834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 338/671] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:38.702830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.742256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad0524-8105-457f-8431-6d413f33a109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.743636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad0524-8105-457f-8431-6d413f33a109 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.799489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694b529-ed2a-4268-b47a-e5b11663d608 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.831861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.832525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.832806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.833078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.833826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:38.834133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.835496 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.840589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 334/672] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:38.840589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad0524-8105-457f-8431-6d413f33a109 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.851574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 339/673] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:38.856524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.931947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad0524-8105-457f-8431-6d413f33a109 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.950774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59e30-902a-42de-9d61-9ccde7973d01 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:38.965407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.966100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.966382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.966656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.967435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:38.967735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.969159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:38.988323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 335/674] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:38.988323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:38.988601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:38.988601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:38.988601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:38.988601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:38.989061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:38.989327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:38.990804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.008199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 340/675] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:39.008199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.096636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fe282-a52f-4db6-9615-847b50fb06e0 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.104692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cd492-90c3-49bf-8d6d-e45ee5ecaffc None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.130907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:39.132136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.132877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.133597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.137655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:39.138440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.138723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.138999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.146541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:39.146684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:39.147973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.148143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:39.162587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:39.163505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:39.164428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:39.168419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 341/676] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:39.168526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:39.174109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:39.175138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:39.175138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:39.175138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:39.175138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:39.175357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.175439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 336/677] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:39.175439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.270251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1be9d-c8b8-42c5-9125-9a922600e494 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.274924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378817df-2282-4d90-9cb7-b8be4fee482c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.303993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:39.304646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.304930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.305199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.306068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=d42155dc7b5f42b79943f99952448202) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:39.306407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:39.307798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.308237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:39.308883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.309165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.309439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.310342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=91feeca74fe749fba52423aa28d48916) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:39.310680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:39.312081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.325977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 337/678] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/role_assignments?user.id=d42155dc7b5f42b79943f99952448202&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:39.325977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.338027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 342/679] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/role_assignments?user.id=91feeca74fe749fba52423aa28d48916&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:39.339235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.439162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350b296-c85a-40ca-9be0-4165b1658b8d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.482228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a1af6-1b2e-4041-859c-b975ae6614f5 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.489765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f69bf-ee0d-4d81-b8fc-615c471402b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:39.490457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f69bf-ee0d-4d81-b8fc-615c471402b1 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.490746 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f69bf-ee0d-4d81-b8fc-615c471402b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.491021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f69bf-ee0d-4d81-b8fc-615c471402b1 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.491883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f69bf-ee0d-4d81-b8fc-615c471402b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:39.492193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f69bf-ee0d-4d81-b8fc-615c471402b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:39.493696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f69bf-ee0d-4d81-b8fc-615c471402b1 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.519140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 338/680] 10.222.0.36 () {56 vars in 1135 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:39.520636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036318d5-7b83-41dd-bf7a-6966836d509f None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.520884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036318d5-7b83-41dd-bf7a-6966836d509f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.521156 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036318d5-7b83-41dd-bf7a-6966836d509f None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.522052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58536c-2d50-4114-88ca-d51e17c0534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:39.522729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58536c-2d50-4114-88ca-d51e17c0534c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.522889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 339/681] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:39.522994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58536c-2d50-4114-88ca-d51e17c0534c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.523269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58536c-2d50-4114-88ca-d51e17c0534c None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.523549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036318d5-7b83-41dd-bf7a-6966836d509f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.524005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58536c-2d50-4114-88ca-d51e17c0534c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:39.524352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58536c-2d50-4114-88ca-d51e17c0534c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:39.529884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58536c-2d50-4114-88ca-d51e17c0534c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.549782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 343/682] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:39.551557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf399-1e8c-43a0-bacb-e6a0694e2c10 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.551893 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf399-1e8c-43a0-bacb-e6a0694e2c10 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.552184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf399-1e8c-43a0-bacb-e6a0694e2c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.570198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-bd4bf399-1e8c-43a0-bacb-e6a0694e2c10 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:39.571421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-bd4bf399-1e8c-43a0-bacb-e6a0694e2c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:39.647585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036318d5-7b83-41dd-bf7a-6966836d509f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.653474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 344/683] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:39.654354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf399-1e8c-43a0-bacb-e6a0694e2c10 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.681357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7453f-032e-4e47-9e40-91cf1ffc18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:39.682076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7453f-032e-4e47-9e40-91cf1ffc18b4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.682356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7453f-032e-4e47-9e40-91cf1ffc18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.682630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7453f-032e-4e47-9e40-91cf1ffc18b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.759461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7453f-032e-4e47-9e40-91cf1ffc18b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:39.760910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7453f-032e-4e47-9e40-91cf1ffc18b4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.777288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf399-1e8c-43a0-bacb-e6a0694e2c10 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.821648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:39.822718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:39.823317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:39.823760 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:39.833386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:39.835275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:39.849624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:39.850776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:39.852303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:39.852303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:39.852303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:39.852303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:39.852303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:39.852303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:39.852303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:39.852303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:39.853398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 345/684] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:39.854222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.868009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 340/685] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:39.869468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7453f-032e-4e47-9e40-91cf1ffc18b4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:39.979400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83956-6f7a-4609-9767-b8daa8f3f029 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:39.989667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7453f-032e-4e47-9e40-91cf1ffc18b4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:40.023707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.024766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.025379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.025703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.026636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.028524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.036094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.036754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.037038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.037315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.038138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:40.038449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.039877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:40.044992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:40.045964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:40.046814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:40.049219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 346/686] 10.222.0.36 () {56 vars in 1129 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:40.049219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:40.053556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 341/687] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:40.055376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:40.151999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616125fa-b638-4312-99f7-b6b1aac9b5f4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:40.184289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214583-a472-4bfe-ac1c-8409be207683 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:40.185638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.187627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.187922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.188196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.201088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.203022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.222365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.223219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.223653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.224031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:40.224424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:40.226207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:40.228244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:40.228244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:40.228244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:40.228244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:40.228708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:40.228708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.228952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 347/688] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:40.228952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:40.229198 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.234847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 342/689] 10.222.0.36 () {56 vars in 1124 bytes} [Wed May 11 07:25:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:40.236507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:40.352708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d7c87-ce86-400c-8eca-283a21eaa592 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:40.358934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa371d-27a8-44c7-b6b5-38bf972e1f8f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:40.387103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.388068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.388529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.388998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.390053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=66b60e827f404e3891e4f24ca842e5b0) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:40.390570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.392210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.399118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 348/690] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:40 2022] GET /identity/v3/role_assignments?user.id=66b60e827f404e3891e4f24ca842e5b0&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:40.399516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.400256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.400656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.400762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:40.401050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.402013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:40.402398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.403881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.425006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 343/691] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:40.434277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:40.514381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19176010-e970-4304-b555-e7e4341d0953 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:40.570005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.571078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.571587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.572076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.573008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:40.573533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.575181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.587653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 349/692] 10.222.0.36 () {56 vars in 1124 bytes} [Wed May 11 07:25:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:40.621534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eff00b-5a6c-4f3d-b32e-3e457b281008 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:40.659580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.660414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.660694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.660965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.668553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.670072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:40.684900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:40.685885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:40.687222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 344/693] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:40.692593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:40.816627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf86889-86a2-46fa-a082-1927b4067845 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:40.851716 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf60e8a-d914-4f1b-b1ba-14e166a464bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:40.852501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60e8a-d914-4f1b-b1ba-14e166a464bb None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:40.852671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60e8a-d914-4f1b-b1ba-14e166a464bb None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:40.852932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60e8a-d914-4f1b-b1ba-14e166a464bb None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:40.853786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf60e8a-d914-4f1b-b1ba-14e166a464bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:40.854103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf60e8a-d914-4f1b-b1ba-14e166a464bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:40.855770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf60e8a-d914-4f1b-b1ba-14e166a464bb None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:40.869842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 350/694] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:40.875320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:40.981453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d1ea7-ed86-41a1-adb2-685fad59ecfc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:41.020566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13434e7-5cef-4f83-a6a5-128756fa18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:41.021571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13434e7-5cef-4f83-a6a5-128756fa18f2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:41.022040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13434e7-5cef-4f83-a6a5-128756fa18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:41.022496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13434e7-5cef-4f83-a6a5-128756fa18f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:41.023505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13434e7-5cef-4f83-a6a5-128756fa18f2 None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=0aa4d2cc79404c2c8fbc1ff8868b386a) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:41.024005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13434e7-5cef-4f83-a6a5-128756fa18f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:41.025663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13434e7-5cef-4f83-a6a5-128756fa18f2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:41.032098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 345/695] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:40 2022] GET /identity/v3/role_assignments?user.id=0aa4d2cc79404c2c8fbc1ff8868b386a&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:41.884535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d40e1-4c98-406f-8334-7b9ae2d11f22 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:41.885027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d40e1-4c98-406f-8334-7b9ae2d11f22 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:41.885027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d40e1-4c98-406f-8334-7b9ae2d11f22 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:41.886393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 351/696] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:41.893867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4cd4-d873-4ee6-8ff2-0e8cc3761394 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:41.894297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4cd4-d873-4ee6-8ff2-0e8cc3761394 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:41.894493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4cd4-d873-4ee6-8ff2-0e8cc3761394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:41.911142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-4b9c4cd4-d873-4ee6-8ff2-0e8cc3761394 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:41.912340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4b9c4cd4-d873-4ee6-8ff2-0e8cc3761394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:41.993656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 346/697] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:42.011239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d40e1-4c98-406f-8334-7b9ae2d11f22 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:42.064968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928219a7-70f6-4655-ab12-f1a4ad8785fb None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:42.065490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928219a7-70f6-4655-ab12-f1a4ad8785fb None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:42.065974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928219a7-70f6-4655-ab12-f1a4ad8785fb None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:42.068200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 347/698] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:42.074401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023f53-e504-4078-b4a1-349adcbc9b75 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:42.075004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023f53-e504-4078-b4a1-349adcbc9b75 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:42.075842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023f53-e504-4078-b4a1-349adcbc9b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:42.096245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-26023f53-e504-4078-b4a1-349adcbc9b75 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:42.097838 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-26023f53-e504-4078-b4a1-349adcbc9b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:42.168860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d40e1-4c98-406f-8334-7b9ae2d11f22 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:42.207635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 348/699] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:42.214248 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090e153-aa72-4e99-98df-15f2f5948773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:42.215056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e153-aa72-4e99-98df-15f2f5948773 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:42.215343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e153-aa72-4e99-98df-15f2f5948773 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:42.215624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090e153-aa72-4e99-98df-15f2f5948773 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:42.229069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090e153-aa72-4e99-98df-15f2f5948773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:42.233918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26023f53-e504-4078-b4a1-349adcbc9b75 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-3090e153-aa72-4e99-98df-15f2f5948773 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:42.244515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:42.245463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:42.246353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 352/700] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:42.247042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090e153-aa72-4e99-98df-15f2f5948773 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:42.363752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26023f53-e504-4078-b4a1-349adcbc9b75 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:42.422353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:42.423605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:42.423971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:42.424144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:42.427810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090e153-aa72-4e99-98df-15f2f5948773 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:42.446586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:42.448052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:42.471631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:42.472652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:42.473302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:42.484764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:42.486351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:42.486868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:42.488531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:42.497779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:42.498653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:42.499560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:42.499560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:42.499560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:42.499560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:42.502100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 349/701] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:42.506866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 353/702] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:42.508018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:42.510797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:42.646921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd017d-bc7c-4768-ba15-d68bcc1920e8 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:42.709838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee3f1d-3154-4cea-8f9d-c6bd80e355e6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:42.721055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:42.722094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:42.722582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:42.723052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:42.723999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:42.724564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:42.726157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:42.752089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 350/703] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:42.762916 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:42.776627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:42.778435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:42.779106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:42.780896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:42.802625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:42.804092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:42.833571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:42.834543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:42.835437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:42.835437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:42.835437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:42.835437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:42.843450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 354/704] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:42.848939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:42.937162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94896e8-ee73-43d2-bfec-dc5bb29da4e3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:42.966592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eab46-3b20-4c5e-9334-2ba6571c9d95 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:43.001078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:43.002107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.002570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.003017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.003935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:43.004420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:43.006000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:43.019816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 355/705] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:43.024481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8a4e5-1f5d-4787-94de-36fa6090e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:43.024481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a4e5-1f5d-4787-94de-36fa6090e24b None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.024481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a4e5-1f5d-4787-94de-36fa6090e24b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.024481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a4e5-1f5d-4787-94de-36fa6090e24b None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.024902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8a4e5-1f5d-4787-94de-36fa6090e24b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:43.024902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8a4e5-1f5d-4787-94de-36fa6090e24b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:43.026288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:43.076185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 351/706] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:25:42 2022] POST /identity/v3/users => generated 254 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:43.156802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9a36-a04b-4d02-885b-edc9e8ef66a3 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:43.194642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:43.195807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.196270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.196723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.210164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:43.212017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:43.221484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4870aa8-05ef-44ae-aa4f-3efdfdcbab1f None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.221700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4870aa8-05ef-44ae-aa4f-3efdfdcbab1f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.221989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4870aa8-05ef-44ae-aa4f-3efdfdcbab1f None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.227129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 352/707] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:43.230995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3733-4eb4-4e32-b073-b158f699ecf8 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.231285 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3733-4eb4-4e32-b073-b158f699ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.231568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3733-4eb4-4e32-b073-b158f699ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:43.234656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:43.235629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:43.236549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:43.239063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 356/708] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:25:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:43.244772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:43.263060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f04a3733-4eb4-4e32-b073-b158f699ecf8 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:43.264271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f04a3733-4eb4-4e32-b073-b158f699ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:43.349276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81f0ba-8657-41e2-ae10-964f6ecc38dd None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:43.385211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:43.386161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.386610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.387030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.388015 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:43.388494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:43.389960 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:43.390231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 353/709] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:43.392221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e47c1-391e-433b-a734-a21ecbaee986 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.392516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e47c1-391e-433b-a734-a21ecbaee986 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.392794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e47c1-391e-433b-a734-a21ecbaee986 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.398419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 354/710] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:43.407600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7d4c-0217-403e-ae41-527d854ceab0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.407896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7d4c-0217-403e-ae41-527d854ceab0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.408147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b7d4c-0217-403e-ae41-527d854ceab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.410857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 357/711] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:25:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:43.416864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:43.431188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-016b7d4c-0217-403e-ae41-527d854ceab0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:43.432366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-016b7d4c-0217-403e-ae41-527d854ceab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:43.512915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 355/712] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 07:25:43.513781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7d4c-0217-403e-ae41-527d854ceab0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:43.539674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b68402-510d-4d29-9e9a-747088fe5f01 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:43.575504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd134-1976-45ad-ac84-8f1092300475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:43.576216 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd134-1976-45ad-ac84-8f1092300475 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.576476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd134-1976-45ad-ac84-8f1092300475 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.576758 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cd134-1976-45ad-ac84-8f1092300475 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.638162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b7d4c-0217-403e-ae41-527d854ceab0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:43.645720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cd134-1976-45ad-ac84-8f1092300475 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:43.647191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cd134-1976-45ad-ac84-8f1092300475 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:43.685679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6281c7-49fa-443b-b53c-b717b3029951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:43.686650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6281c7-49fa-443b-b53c-b717b3029951 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.687543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6281c7-49fa-443b-b53c-b717b3029951 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.688005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6281c7-49fa-443b-b53c-b717b3029951 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.689469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6281c7-49fa-443b-b53c-b717b3029951 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:43.691499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6281c7-49fa-443b-b53c-b717b3029951 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:43.716307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 356/713] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:25:43 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:43.717665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6281c7-49fa-443b-b53c-b717b3029951 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:43.807646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 358/714] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:43.829727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd134-1976-45ad-ac84-8f1092300475 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:43.867415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6281c7-49fa-443b-b53c-b717b3029951 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:43.909571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:43.910459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:43.910747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:43.911024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:43.911744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:43.913147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:43.928500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:43.929628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:43.930491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:43.935190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 357/715] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:43 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:43.936563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:43.992438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cd134-1976-45ad-ac84-8f1092300475 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.039385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.040258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.040548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.040823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.058329 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.059730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:44.086818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:44.088924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:44.091177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:44.091177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:44.091177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:44.091177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:44.091177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 359/716] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:44.099247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.103190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4eacf-38e4-4f62-bfa4-c572828ba0f7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.147813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a259e-c1c5-4422-8dba-e27ca6840fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.148280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a259e-c1c5-4422-8dba-e27ca6840fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.148568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a259e-c1c5-4422-8dba-e27ca6840fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.148843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a259e-c1c5-4422-8dba-e27ca6840fc9 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.149595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a259e-c1c5-4422-8dba-e27ca6840fc9 None admin] RBAC: Adding query filter params (name=network) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:44.149898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a259e-c1c5-4422-8dba-e27ca6840fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.151271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a259e-c1c5-4422-8dba-e27ca6840fc9 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.156907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 358/717] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:25:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:44.159131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a9cea-f424-4fd4-b8d8-5d1283745f58 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.159131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a9cea-f424-4fd4-b8d8-5d1283745f58 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.159323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a9cea-f424-4fd4-b8d8-5d1283745f58 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.160553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 359/718] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:44.162975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a9cea-f424-4fd4-b8d8-5d1283745f58 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.231494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274649c8-eefe-40cb-be55-3d348ece7d39 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.265645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d663a6-7825-4ce3-9ec5-7a9658906f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.266312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d663a6-7825-4ce3-9ec5-7a9658906f7d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.266621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d663a6-7825-4ce3-9ec5-7a9658906f7d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.266892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d663a6-7825-4ce3-9ec5-7a9658906f7d None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.267609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d663a6-7825-4ce3-9ec5-7a9658906f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:44.267909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d663a6-7825-4ce3-9ec5-7a9658906f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.269263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d663a6-7825-4ce3-9ec5-7a9658906f7d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.280472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 360/719] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:44.281792 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2cac-e089-41db-9e57-673c48752d7f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.282610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2cac-e089-41db-9e57-673c48752d7f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.282886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2cac-e089-41db-9e57-673c48752d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.285246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a9cea-f424-4fd4-b8d8-5d1283745f58 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.301574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-827b2cac-e089-41db-9e57-673c48752d7f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:44.302784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-827b2cac-e089-41db-9e57-673c48752d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:44.323939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.324522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.329560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.329560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.329560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] RBAC: Adding query filter params (type=network) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:44.329560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.329560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.333812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 360/720] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:25:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:44.334731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.426525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 361/721] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:44.455854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b2cac-e089-41db-9e57-673c48752d7f None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.535439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3641064-059a-422e-be9b-367a2c8be9eb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.596741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.597944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.597944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.598119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.604890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b2cac-e089-41db-9e57-673c48752d7f None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.605023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.606459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:44.620967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:44.621930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:44.623688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 361/722] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:44.630762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.646513 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4284f6-e47b-4294-9d2a-2c9909921271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.647646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4284f6-e47b-4294-9d2a-2c9909921271 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.648135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4284f6-e47b-4294-9d2a-2c9909921271 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.648610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4284f6-e47b-4294-9d2a-2c9909921271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.662106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4284f6-e47b-4294-9d2a-2c9909921271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-da4284f6-e47b-4294-9d2a-2c9909921271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:44.670330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:44.671265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:44.672176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 362/723] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:44.676810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4284f6-e47b-4294-9d2a-2c9909921271 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.795756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08f64b-31ea-40c2-89f0-7c52a8260aa1 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.845487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4284f6-e47b-4294-9d2a-2c9909921271 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:44.862266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.863232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.863719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.864207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.865227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:44.866446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.868264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.892349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 362/724] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:44.903781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:44.915392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:44.916342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:44.916775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:44.917232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:44.918150 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:44.918623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:44.920156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:44.937853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 363/725] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:44.942492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.020258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16b76-967c-4b58-bd16-086ceac4a0e8 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.055260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.056197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.056631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.057367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.058381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=d42155dc7b5f42b79943f99952448202) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:45.058866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.060922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.068263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 363/726] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:44 2022] GET /identity/v3/role_assignments?user.id=d42155dc7b5f42b79943f99952448202&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=de114c58fdc8476ebab657e6f9359155 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:45.123522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d2f10-bd28-4e84-8fa0-b9ba97ef4cf1 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.169273 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.170393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.170827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.171246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.183490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.185170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:45.207880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:45.209033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:45.210175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:45.210175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:45.210175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:45.210175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:45.212236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 364/727] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:45.217569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.346366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03174e-3e70-44e6-9d38-397e90ff7e41 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.389494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.390527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.390969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.391471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.392393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:45.392870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.394505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.412415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 364/728] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:45.417836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.526849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af51a-2fba-4fe6-a326-38300c9173b9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.569111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fed57-2d84-49a7-b102-65f7c724c138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.569948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fed57-2d84-49a7-b102-65f7c724c138 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.570235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fed57-2d84-49a7-b102-65f7c724c138 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.570509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fed57-2d84-49a7-b102-65f7c724c138 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.578795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fed57-2d84-49a7-b102-65f7c724c138 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.580283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631fed57-2d84-49a7-b102-65f7c724c138 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-631fed57-2d84-49a7-b102-65f7c724c138 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:45.600299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:45.601272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:45.602279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 365/729] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:45.608491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.718588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65d83-35ac-4237-8342-4d588659da98 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.718937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65d83-35ac-4237-8342-4d588659da98 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.719153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65d83-35ac-4237-8342-4d588659da98 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.721185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 366/730] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:45.726033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9686-66e0-485b-a538-5370648f95af None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.726249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6486a1-4858-429f-b61c-3118ae93cba1 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.726354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9686-66e0-485b-a538-5370648f95af None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.726584 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9686-66e0-485b-a538-5370648f95af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.762802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c36d9686-66e0-485b-a538-5370648f95af None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:45.763998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c36d9686-66e0-485b-a538-5370648f95af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:45.768725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.769402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.769714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.769992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:45.770840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:45.771149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:45.772658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:45.808056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 365/731] 10.222.0.36 () {56 vars in 1135 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:45.813396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.866540 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 367/732] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:45.900912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d9686-66e0-485b-a538-5370648f95af None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:45.951739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9785c-a4f8-4cb9-87ac-b348a653b92a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:45.998367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e771a-987d-4f30-b8ec-b8d3ab3b5ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:45.999012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e771a-987d-4f30-b8ec-b8d3ab3b5ec5 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:45.999301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e771a-987d-4f30-b8ec-b8d3ab3b5ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:45.999574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e771a-987d-4f30-b8ec-b8d3ab3b5ec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.056493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d9686-66e0-485b-a538-5370648f95af None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.096486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6e93-db51-4ca8-9694-5870e106b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.097295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6e93-db51-4ca8-9694-5870e106b165 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.097600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6e93-db51-4ca8-9694-5870e106b165 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.097879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6e93-db51-4ca8-9694-5870e106b165 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.115633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c6e93-db51-4ca8-9694-5870e106b165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:46.125200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e771a-987d-4f30-b8ec-b8d3ab3b5ec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.126721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e771a-987d-4f30-b8ec-b8d3ab3b5ec5 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-b34c6e93-db51-4ca8-9694-5870e106b165 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:46.129200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:46.130449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:46.131339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 368/733] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:46.138691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6e93-db51-4ca8-9694-5870e106b165 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.301618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 366/734] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 07:25:46.303572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6e93-db51-4ca8-9694-5870e106b165 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.308107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e771a-987d-4f30-b8ec-b8d3ab3b5ec5 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.369440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.370263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.370472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.370712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.371474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:46.371784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.373174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.392657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 369/735] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:46.398064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.432354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e771a-987d-4f30-b8ec-b8d3ab3b5ec5 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.483936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a50a8-7ab3-48e1-9574-69f16867e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.485250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a50a8-7ab3-48e1-9574-69f16867e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.485250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a50a8-7ab3-48e1-9574-69f16867e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.485388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a50a8-7ab3-48e1-9574-69f16867e7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.508404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a50a8-7ab3-48e1-9574-69f16867e7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.509896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a50a8-7ab3-48e1-9574-69f16867e7e4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7b5a50a8-7ab3-48e1-9574-69f16867e7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:46.541332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:46.542318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:46.543226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:46.543226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:46.543226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:46.543226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:46.555200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 367/736] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:46.557019 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccba1b2-28f2-4570-88d3-8ac91eec61fc None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.557529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccba1b2-28f2-4570-88d3-8ac91eec61fc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.558047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccba1b2-28f2-4570-88d3-8ac91eec61fc None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.559318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa182440-a371-4dd4-839f-408e9e736c7c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.560046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 368/737] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:46.565915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccba1b2-28f2-4570-88d3-8ac91eec61fc None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.596372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c138c03-0a15-48db-aa91-34decfe28599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.597324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138c03-0a15-48db-aa91-34decfe28599 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.597645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138c03-0a15-48db-aa91-34decfe28599 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.597930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138c03-0a15-48db-aa91-34decfe28599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.610725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c138c03-0a15-48db-aa91-34decfe28599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.612235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c138c03-0a15-48db-aa91-34decfe28599 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-2c138c03-0a15-48db-aa91-34decfe28599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:46.630089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:46.631000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:46.631878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:46.631878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:46.631878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:46.631878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:46.631878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 370/738] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:46.637499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcf7df-da73-4746-9469-8d1b0e47b5c9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.637813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcf7df-da73-4746-9469-8d1b0e47b5c9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.638093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcf7df-da73-4746-9469-8d1b0e47b5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.655016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d1bcf7df-da73-4746-9469-8d1b0e47b5c9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:46.656196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d1bcf7df-da73-4746-9469-8d1b0e47b5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:46.684143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccba1b2-28f2-4570-88d3-8ac91eec61fc None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.726744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 371/739] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:46.727627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcf7df-da73-4746-9469-8d1b0e47b5c9 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.728050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.728646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.728929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.729206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.730161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:46.731293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.732687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.747590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 369/740] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:46.758588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.829449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcf7df-da73-4746-9469-8d1b0e47b5c9 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.858095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51b042-5c04-4cd7-ba57-7d7a4db5b519 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:46.868931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.869612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.869895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.870169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.870891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:46.871191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.872552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.884429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 372/741] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:46.885219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.896429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:46.897234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:46.897524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:46.897858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:46.904925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:46.906460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:46.921076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:46.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 370/742] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:46.925743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:46.991252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9dcf-77a6-4e7e-b19c-926981b12efb None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.024369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.025171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.025450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.025749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.026398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.027764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.027953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a0915-2114-4019-b96b-5ee74b525aef None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:47.040498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:47.042726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:47.045389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:47.056322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 373/743] 10.222.0.36 () {56 vars in 1129 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:47.056322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.063446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.064267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.064554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.064829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.072097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.073657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:47.089123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:47.091524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 371/744] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:25:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:47.093970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.152156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffa8de-7160-4b92-8a02-ac77aea9db55 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.186107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.186819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.187099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.187623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.188483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:47.188789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.188960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591aad7-bb17-487e-af69-a4bd979d3f4b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.190231 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.206627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 374/745] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:47.206627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.226864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed02bf-74ec-458f-992a-2d8bd803c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.227525 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed02bf-74ec-458f-992a-2d8bd803c628 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.227805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed02bf-74ec-458f-992a-2d8bd803c628 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.228085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed02bf-74ec-458f-992a-2d8bd803c628 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.228783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed02bf-74ec-458f-992a-2d8bd803c628 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:47.229090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed02bf-74ec-458f-992a-2d8bd803c628 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.230483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed02bf-74ec-458f-992a-2d8bd803c628 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.234908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 372/746] 10.222.0.36 () {56 vars in 1124 bytes} [Wed May 11 07:25:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:47.236745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f731cee-244d-44b4-8893-52e04f72dbb3 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.237014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f731cee-244d-44b4-8893-52e04f72dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.237284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f731cee-244d-44b4-8893-52e04f72dbb3 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.238682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 373/747] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:47.239190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f731cee-244d-44b4-8893-52e04f72dbb3 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.306327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2749d34-3d63-4078-8223-57a83217f3bd None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.338890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f731cee-244d-44b4-8893-52e04f72dbb3 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.339574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14249b40-bbea-4914-bdfe-688289311d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.340142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14249b40-bbea-4914-bdfe-688289311d00 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.340422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14249b40-bbea-4914-bdfe-688289311d00 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.340691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14249b40-bbea-4914-bdfe-688289311d00 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.341527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14249b40-bbea-4914-bdfe-688289311d00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:47.341856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14249b40-bbea-4914-bdfe-688289311d00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.343276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14249b40-bbea-4914-bdfe-688289311d00 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.360401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 375/748] 10.222.0.36 () {56 vars in 1149 bytes} [Wed May 11 07:25:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:47.361905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b81f6-65b4-4599-bf30-be3c108addf9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.362191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b81f6-65b4-4599-bf30-be3c108addf9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.362465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b81f6-65b4-4599-bf30-be3c108addf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.377851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-929b81f6-65b4-4599-bf30-be3c108addf9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:47.378714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.378987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-929b81f6-65b4-4599-bf30-be3c108addf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:47.379790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.380256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.380710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.381743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=0aa4d2cc79404c2c8fbc1ff8868b386a) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:47.382062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.383495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.389374 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 374/749] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:47 2022] GET /identity/v3/role_assignments?user.id=0aa4d2cc79404c2c8fbc1ff8868b386a&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=de114c58fdc8476ebab657e6f9359155 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:47.390691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.463833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 376/750] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 07:25:47.465017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b81f6-65b4-4599-bf30-be3c108addf9 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.545291 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9d9bf-dc19-4d97-a9ca-070c2ae82ed2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.587354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b81f6-65b4-4599-bf30-be3c108addf9 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.600214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.600829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.601115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.601393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.602182 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:47.602493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.604476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.612673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 375/751] 10.222.0.36 () {56 vars in 1124 bytes} [Wed May 11 07:25:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:47.613569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.625581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614199eb-292d-4de3-a0d5-59358ce96583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.626630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614199eb-292d-4de3-a0d5-59358ce96583 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.627109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614199eb-292d-4de3-a0d5-59358ce96583 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.627627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614199eb-292d-4de3-a0d5-59358ce96583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.708070 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614199eb-292d-4de3-a0d5-59358ce96583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.710951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614199eb-292d-4de3-a0d5-59358ce96583 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.723499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43492f12-0ef8-45e8-a923-6d8ae72ff24a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.758969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600f786-c77a-4132-a86e-e01b9a645b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.759905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600f786-c77a-4132-a86e-e01b9a645b73 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.760399 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600f786-c77a-4132-a86e-e01b9a645b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.760882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600f786-c77a-4132-a86e-e01b9a645b73 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.761734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600f786-c77a-4132-a86e-e01b9a645b73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.763121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600f786-c77a-4132-a86e-e01b9a645b73 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.778200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 376/752] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:25:47 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:47.779109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600f786-c77a-4132-a86e-e01b9a645b73 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.841519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 377/753] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:47 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 07:25:47.843070 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d9267-50a9-4d78-8544-ce3345fb24d0 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.843454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d9267-50a9-4d78-8544-ce3345fb24d0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.843930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d9267-50a9-4d78-8544-ce3345fb24d0 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.849720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 378/754] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:47.850930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d9267-50a9-4d78-8544-ce3345fb24d0 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:47.914854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600f786-c77a-4132-a86e-e01b9a645b73 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:47.957311 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e63ad-8c20-414e-8963-1469ae6dbd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:47.958040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e63ad-8c20-414e-8963-1469ae6dbd7a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.958385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e63ad-8c20-414e-8963-1469ae6dbd7a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.958669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e63ad-8c20-414e-8963-1469ae6dbd7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.959510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e63ad-8c20-414e-8963-1469ae6dbd7a None admin] RBAC: Adding query filter params (interface=public, service_id=9f5746080dc94431a3df5f02ddaa3b67, region_id=RegionOne) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:47.959832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e63ad-8c20-414e-8963-1469ae6dbd7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:47.961286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e63ad-8c20-414e-8963-1469ae6dbd7a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:47.970412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 377/755] 10.222.0.36 () {56 vars in 1251 bytes} [Wed May 11 07:25:47 2022] GET /identity/v3/endpoints?service_id=9f5746080dc94431a3df5f02ddaa3b67&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:47.971926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9fdfc-9268-417b-9502-ef6138f1bcab None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:47.972222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9fdfc-9268-417b-9502-ef6138f1bcab None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:47.972499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9fdfc-9268-417b-9502-ef6138f1bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:47.990769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-81e9fdfc-9268-417b-9502-ef6138f1bcab None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:47.991976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-81e9fdfc-9268-417b-9502-ef6138f1bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:48.067355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 378/756] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:48.068440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9fdfc-9268-417b-9502-ef6138f1bcab None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:48.123295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d9267-50a9-4d78-8544-ce3345fb24d0 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:48.163109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:48.164169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:48.164450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:48.164722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:48.177851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:48.179920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:48.187593 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9fdfc-9268-417b-9502-ef6138f1bcab None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:48.202399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:48.203521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:48.204737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:48.204737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:48.204737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:48.204737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:48.204737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 379/757] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:48.205333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:48.228272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44e169-461a-4f40-991f-456996a41b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:48.229123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44e169-461a-4f40-991f-456996a41b6f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:48.229481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44e169-461a-4f40-991f-456996a41b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:48.229857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44e169-461a-4f40-991f-456996a41b6f None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:48.231048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44e169-461a-4f40-991f-456996a41b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:48.232836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44e169-461a-4f40-991f-456996a41b6f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:48.240834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 379/758] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:25:48 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:48.241763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44e169-461a-4f40-991f-456996a41b6f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:48.384982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8facf-f0f1-4a42-b7da-57631d5d9265 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:48.436973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44e169-461a-4f40-991f-456996a41b6f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:48.461680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb7c9-a3dd-4307-b623-0dc555de94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:48.462816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb7c9-a3dd-4307-b623-0dc555de94ac None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:48.463337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb7c9-a3dd-4307-b623-0dc555de94ac None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:48.463801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb7c9-a3dd-4307-b623-0dc555de94ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:48.475256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fb7c9-a3dd-4307-b623-0dc555de94ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-411fb7c9-a3dd-4307-b623-0dc555de94ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:48.483186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:48.484128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:48.485044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:48.488724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 380/759] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:48.493984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb7c9-a3dd-4307-b623-0dc555de94ac None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:48.494490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:48.495380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:48.495866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:48.496364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:48.497280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:48.497822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:48.499391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:48.515495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 380/760] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:48.520792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:48.638715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0ef86-99f9-492a-98b1-2615bbb6e751 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:48.663658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb7c9-a3dd-4307-b623-0dc555de94ac None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:48.683553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:48.684725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:48.685201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:48.685701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:48.696174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:48.697911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:48.707953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:48.708630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:48.708909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:48.709179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:48.709949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:48.710252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:48.711626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:48.722013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:48.722883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:48.723741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 381/761] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:48.731274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 381/762] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:48.732294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:48.737007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:48.883148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c175a-52cd-4d05-81b8-2f0579fc47ae None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:48.923595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:48.924260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:48.924536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:48.924805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:48.925608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:48.925915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:48.927337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:48.939744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6274073-d041-4b7d-9d57-89405f67843f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:48.955339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 382/763] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:48.960640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:48.984725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:48.985948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:48.986430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:48.986913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:49.006306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:49.009226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:49.053958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:49.054905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:49.055780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:49.055780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:49.055780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:49.055780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:49.059536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 382/764] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:49.064175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:49.142872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ede59d-a363-4862-afd3-58756eb5ab8c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:49.181417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:49.182454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:49.182947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:49.183425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:49.184460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=044d9c04530347b9a03e9c4c352063bf) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:49.185632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:49.188174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:49.196621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 383/765] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:48 2022] GET /identity/v3/role_assignments?user.id=044d9c04530347b9a03e9c4c352063bf&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:49.257665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499805aa-9047-4801-8e61-a08ec8fc76ea None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:49.309842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:49.310890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:49.311397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:49.311885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:49.313082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:49.314148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:49.315730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:49.333507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 383/766] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:49.339398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:49.441047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da050696-089a-4a7d-9851-447bad2ca56f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:49.476103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:49.477250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:49.477785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:49.478252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:49.487642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:49.487642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:49.503391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:49.504329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:49.505247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 384/767] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:25:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:49.511954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:49.642825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581118d-6481-4fe3-8425-29076fbd4c42 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:49.699956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cdb3c-2417-4d43-80aa-511189195a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:49.700560 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cdb3c-2417-4d43-80aa-511189195a4d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:49.700837 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cdb3c-2417-4d43-80aa-511189195a4d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:49.701108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cdb3c-2417-4d43-80aa-511189195a4d None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:49.701979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cdb3c-2417-4d43-80aa-511189195a4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:49.702284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cdb3c-2417-4d43-80aa-511189195a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:49.703701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cdb3c-2417-4d43-80aa-511189195a4d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:49.729443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 384/768] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:25:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:49.734779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:49.876510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484d26e-250c-4be1-b4fd-cae3dc9caa0b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:49.923720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:49.924590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:49.924881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:49.925159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:49.941747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:49.943327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:49.954412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e86e-7271-4572-92f1-8ae3f958466d None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:49.954668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e86e-7271-4572-92f1-8ae3f958466d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:49.954895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8e86e-7271-4572-92f1-8ae3f958466d None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:49.956487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 385/769] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:49.962421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6600c-7ead-46a6-ba8a-8f8a3da22cd8 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:49.962706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6600c-7ead-46a6-ba8a-8f8a3da22cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:49.962982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6600c-7ead-46a6-ba8a-8f8a3da22cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:49.970416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:49.971273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:49.972144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:49.972144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:49.972144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:49.972144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:49.972144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 385/770] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:49.978957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.002591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a5a6600c-7ead-46a6-ba8a-8f8a3da22cd8 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:50.003802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a5a6600c-7ead-46a6-ba8a-8f8a3da22cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:50.079477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb6a91-7ccc-4db7-9627-5c670c301d56 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:50.117372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:50.118054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.118330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.118599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.119325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:50.119624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:50.121039 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:50.142895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 386/771] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:50.147812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.149586 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 386/772] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:50.174986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6600c-7ead-46a6-ba8a-8f8a3da22cd8 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.277865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157bf40-b089-42ca-88e7-6737e9aa2041 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:50.317730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:50.318455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.318683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.319469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.333717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:50.335173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:50.353093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:50.354072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:50.354959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 387/773] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:50.362351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.388483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6600c-7ead-46a6-ba8a-8f8a3da22cd8 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:50.465886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d0b5f-e13c-47cd-8611-2b2ec22256c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:50.466694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0b5f-e13c-47cd-8611-2b2ec22256c8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.466981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0b5f-e13c-47cd-8611-2b2ec22256c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.467288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d0b5f-e13c-47cd-8611-2b2ec22256c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.487284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d0b5f-e13c-47cd-8611-2b2ec22256c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-3c5d0b5f-e13c-47cd-8611-2b2ec22256c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:50.495353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:50.496279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:50.497100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:50.499827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 387/774] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:50.501409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df80b-1a7a-417c-92cb-73a8de3235fb None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.501920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df80b-1a7a-417c-92cb-73a8de3235fb None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.502393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5df80b-1a7a-417c-92cb-73a8de3235fb None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.507954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21573c76-d105-4db2-ad80-008f7d58f600 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:50.508565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 388/775] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:50.509606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5df80b-1a7a-417c-92cb-73a8de3235fb None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.539772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2891ee-fcfa-4e84-955f-17bec9d708c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:50.540336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2891ee-fcfa-4e84-955f-17bec9d708c2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.540621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2891ee-fcfa-4e84-955f-17bec9d708c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.540896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2891ee-fcfa-4e84-955f-17bec9d708c2 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.541812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2891ee-fcfa-4e84-955f-17bec9d708c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:50.542014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2891ee-fcfa-4e84-955f-17bec9d708c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:50.543526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2891ee-fcfa-4e84-955f-17bec9d708c2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:50.560994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 388/776] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:50.560994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f76c-7bad-410b-9846-3f5263226af6 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.560994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f76c-7bad-410b-9846-3f5263226af6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.560994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91f76c-7bad-410b-9846-3f5263226af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.576966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-af91f76c-7bad-410b-9846-3f5263226af6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:50.578294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-af91f76c-7bad-410b-9846-3f5263226af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:50.621823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5df80b-1a7a-417c-92cb-73a8de3235fb None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:50.661577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 389/777] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:50.661577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91f76c-7bad-410b-9846-3f5263226af6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.675570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:50.676620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.677105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.677582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.678515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:50.679028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:50.680601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:50.699068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 389/778] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:50.702862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.777958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91f76c-7bad-410b-9846-3f5263226af6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:50.805872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd5c6-03ad-45a5-af6b-293e043baf39 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:50.812696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c4254-466c-4bc9-959f-5d79973c49c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:50.814123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c4254-466c-4bc9-959f-5d79973c49c3 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.814400 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c4254-466c-4bc9-959f-5d79973c49c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.814671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c4254-466c-4bc9-959f-5d79973c49c3 None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/d42155dc7b5f42b79943f99952448202/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.816752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c4254-466c-4bc9-959f-5d79973c49c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=d42155dc7b5f42b79943f99952448202, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:50.818235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c4254-466c-4bc9-959f-5d79973c49c3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:50.841919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 390/779] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:25:50 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/d42155dc7b5f42b79943f99952448202/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:50.841919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c4254-466c-4bc9-959f-5d79973c49c3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.853835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:50.857526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.857526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.857526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] PATH_INFO: `/v3/services/network` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.857526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:50.858021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:50.879864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:50.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:50.881807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:50.893987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 390/780] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:50 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:50.895258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:50.943260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c4254-466c-4bc9-959f-5d79973c49c3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:50.980405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0263d07-d4b5-4e76-9194-2627e9e8df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:50.981041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263d07-d4b5-4e76-9194-2627e9e8df2b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:50.981322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263d07-d4b5-4e76-9194-2627e9e8df2b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:50.981621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0263d07-d4b5-4e76-9194-2627e9e8df2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:50.994013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0263d07-d4b5-4e76-9194-2627e9e8df2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:50.995910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0263d07-d4b5-4e76-9194-2627e9e8df2b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-a0263d07-d4b5-4e76-9194-2627e9e8df2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:51.017235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:51.018227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:51.019794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:51.019794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:51.019794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:51.019794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:51.019794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 391/781] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:51.020651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31dbc-f567-4f0e-9744-7a235c0498bc None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.021176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31dbc-f567-4f0e-9744-7a235c0498bc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.021697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab31dbc-f567-4f0e-9744-7a235c0498bc None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.023396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 392/782] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:51.024095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab31dbc-f567-4f0e-9744-7a235c0498bc None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.030751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4e475-f9fb-4d72-80d3-b9f31be8241e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.072973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5efb3b-078a-4b38-88d3-a92c72ddc724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.074680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efb3b-078a-4b38-88d3-a92c72ddc724 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.075106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efb3b-078a-4b38-88d3-a92c72ddc724 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.075519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efb3b-078a-4b38-88d3-a92c72ddc724 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.076631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5efb3b-078a-4b38-88d3-a92c72ddc724 None admin] RBAC: Adding query filter params (name=network) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:51.077109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5efb3b-078a-4b38-88d3-a92c72ddc724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.080160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5efb3b-078a-4b38-88d3-a92c72ddc724 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.092822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 391/783] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:25:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:51.092822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7772486-cb0f-4fe8-a8a3-d9dc4def2bff None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.092822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7772486-cb0f-4fe8-a8a3-d9dc4def2bff None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.092822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7772486-cb0f-4fe8-a8a3-d9dc4def2bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.114504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e7772486-cb0f-4fe8-a8a3-d9dc4def2bff None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:51.115723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e7772486-cb0f-4fe8-a8a3-d9dc4def2bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:51.159780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab31dbc-f567-4f0e-9744-7a235c0498bc None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.189649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 392/784] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:51.190525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7772486-cb0f-4fe8-a8a3-d9dc4def2bff None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.196600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.197517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.198028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.198507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.199448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:51.199952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.201509 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.213482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 393/785] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:51.219360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.306909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7772486-cb0f-4fe8-a8a3-d9dc4def2bff None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.319679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf072e-98d1-4572-a80e-3692b7b4dccd None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.340822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.341370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.341679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.341952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.342655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] RBAC: Adding query filter params (type=network) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:51.342957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.344362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.353633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 393/786] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:51.355354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.359147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.360709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.360821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.361052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.369988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.371445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:51.386352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:51.387284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 394/787] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:51.388609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.464065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125012e-4598-4f27-b809-130c59a0657e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.499793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.500945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.501423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.501915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.502786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.504349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.506459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb78b4f-d234-4a21-beb8-bc842e8c689a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:51.517345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:51.518372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 07:25:51.519173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:51.526084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 394/788] 10.222.0.36 () {56 vars in 1129 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:51.527401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.546817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.547568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.548333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.548609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.549734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] RBAC: Adding query filter params (interface=public, service_id=cef6c1278206453baeff96588d277c8a, region_id=RegionOne) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:51.549734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.551195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.557062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 395/789] 10.222.0.36 () {56 vars in 1251 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/endpoints?service_id=cef6c1278206453baeff96588d277c8a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:51.562164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.635113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adfa1c-2264-4e12-8c79-8d6c70183b0e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.660365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025db9ea-4d56-45b1-adf6-617c51fad7fb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.670265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.671272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.671780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.672255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.673895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:51.674408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.676037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.694538 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 395/790] 10.222.0.36 () {56 vars in 1135 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:51.695826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.698303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.698987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.699272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.699548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.700943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:51.700943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.701962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.712275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 396/791] 10.222.0.36 () {56 vars in 1124 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:51.712275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.799526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affa9e1-96c0-48a2-a7ad-f593ac30c906 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.804478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419531b-463d-454d-af64-ec74249f3720 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:51.835460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb656ec5-3a16-434d-b500-da21532e7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.836211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656ec5-3a16-434d-b500-da21532e7d9a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.836495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656ec5-3a16-434d-b500-da21532e7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.836764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656ec5-3a16-434d-b500-da21532e7d9a None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.837433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb656ec5-3a16-434d-b500-da21532e7d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.838824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb656ec5-3a16-434d-b500-da21532e7d9a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.838936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a8939-6d86-4db9-95a8-b3ac07caff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:51.839665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a8939-6d86-4db9-95a8-b3ac07caff84 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.839952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a8939-6d86-4db9-95a8-b3ac07caff84 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.840227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a8939-6d86-4db9-95a8-b3ac07caff84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.844416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 396/792] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:51.846433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8df9-8f73-4dbb-b612-761919ed8e16 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.846850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8df9-8f73-4dbb-b612-761919ed8e16 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.847252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8df9-8f73-4dbb-b612-761919ed8e16 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.848678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 397/793] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:51.849561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c8df9-8f73-4dbb-b612-761919ed8e16 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.857056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a8939-6d86-4db9-95a8-b3ac07caff84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:51.858585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a8939-6d86-4db9-95a8-b3ac07caff84 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-895a8939-6d86-4db9-95a8-b3ac07caff84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:51.878995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:51.879991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:51.880867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:51.880867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:51.880867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:51.880867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:51.885072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 397/794] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:51.886625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9c29-3e29-4c7a-a323-11a97d55d855 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:51.886856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9c29-3e29-4c7a-a323-11a97d55d855 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:51.887131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd9c29-3e29-4c7a-a323-11a97d55d855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:51.904863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b3bd9c29-3e29-4c7a-a323-11a97d55d855 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:51.906122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b3bd9c29-3e29-4c7a-a323-11a97d55d855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:51.985249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 398/795] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:51.986413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd9c29-3e29-4c7a-a323-11a97d55d855 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:51.987660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c8df9-8f73-4dbb-b612-761919ed8e16 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.033057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.033815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.034097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.034369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.035081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:52.035386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.036810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.042101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 398/796] 10.222.0.36 () {56 vars in 1124 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:52.043263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:52.135416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd9c29-3e29-4c7a-a323-11a97d55d855 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.149829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc387855-56dc-43f6-8165-fe9cb27afa83 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.171238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.171905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.172185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.172485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.173204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:52.173505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.174907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.185072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0db5d-8368-41d2-b976-d64b77405bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.185924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0db5d-8368-41d2-b976-d64b77405bd8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.186208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0db5d-8368-41d2-b976-d64b77405bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.186486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0db5d-8368-41d2-b976-d64b77405bd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.186773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 399/797] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:52.187932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:52.198804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0db5d-8368-41d2-b976-d64b77405bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-6ae0db5d-8368-41d2-b976-d64b77405bd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:52.207348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:52.208261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 399/798] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:52.209901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0db5d-8368-41d2-b976-d64b77405bd8 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:52.286627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb5ab8-bf67-408d-a48f-0492a4791d02 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.310185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0db5d-8368-41d2-b976-d64b77405bd8 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.321043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ba02c-8812-406c-a145-d08b13a6e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.321740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ba02c-8812-406c-a145-d08b13a6e76d None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.322022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ba02c-8812-406c-a145-d08b13a6e76d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.322288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ba02c-8812-406c-a145-d08b13a6e76d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.323128 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ba02c-8812-406c-a145-d08b13a6e76d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.324501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ba02c-8812-406c-a145-d08b13a6e76d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.346826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.347681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.347969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.348249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.354048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 400/799] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:25:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:52.355427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ba02c-8812-406c-a145-d08b13a6e76d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:52.359693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.361317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:52.390155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:52.393360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:52.395547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 400/800] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:52.401893 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:52.565517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ba02c-8812-406c-a145-d08b13a6e76d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.577842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe897911-77d0-4a7c-8298-570913246cb3 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.603427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.604440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.604916 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.605336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.606259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:52.606712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.608232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.620119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.620778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.621117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.621273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 401/801] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:52.621395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.629613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:52.629613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.629613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.629924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:52.638244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 401/802] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:52.645214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:52.735617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994e35c-91bd-4f2c-ad63-8626905656cb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.745676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af272da9-d18d-4958-91cd-8e3c22ccf75a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.773079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.774296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.774782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.775268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.780763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a83cc-5f4f-424a-bc35-f83e55b3f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.781680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a83cc-5f4f-424a-bc35-f83e55b3f880 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.782006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a83cc-5f4f-424a-bc35-f83e55b3f880 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.782281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a83cc-5f4f-424a-bc35-f83e55b3f880 None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/0aa4d2cc79404c2c8fbc1ff8868b386a/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.784265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a83cc-5f4f-424a-bc35-f83e55b3f880 None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=0aa4d2cc79404c2c8fbc1ff8868b386a, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.786004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a83cc-5f4f-424a-bc35-f83e55b3f880 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.788090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.790042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.801759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 402/803] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:25:52 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/0aa4d2cc79404c2c8fbc1ff8868b386a/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:52.817569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:52.818540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:52.819420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:52.819420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:52.819420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:52.819420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:52.819420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 402/804] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:52.821141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a83cc-5f4f-424a-bc35-f83e55b3f880 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:52.928338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a83cc-5f4f-424a-bc35-f83e55b3f880 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:52.969053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:52.970289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:52.970570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:52.970841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:52.971573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:52.971877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:52.973245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:52.990785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 403/805] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:52.998705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:53.124526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0b2c-256b-4052-9fc3-86b6bd7fd8f2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:53.161895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6a280-af27-486a-9efd-88c300eb5bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:53.162719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a280-af27-486a-9efd-88c300eb5bf5 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.162998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a280-af27-486a-9efd-88c300eb5bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.163269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a280-af27-486a-9efd-88c300eb5bf5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.171110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a280-af27-486a-9efd-88c300eb5bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:53.173205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a280-af27-486a-9efd-88c300eb5bf5 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7de6a280-af27-486a-9efd-88c300eb5bf5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:53.188401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:53.189377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:53.190385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 403/806] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:25:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:53.200981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:53.312522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eb3e1-d148-4bd8-8bac-99706188e75f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:53.325927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae6fc-a44c-4bd7-91c1-2cec2dde21f1 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.326319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae6fc-a44c-4bd7-91c1-2cec2dde21f1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.326669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae6fc-a44c-4bd7-91c1-2cec2dde21f1 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.328342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 404/807] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:53.333894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b2d87-7e87-45d4-b510-9bf0ed34114a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.334254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b2d87-7e87-45d4-b510-9bf0ed34114a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.334592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b2d87-7e87-45d4-b510-9bf0ed34114a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.351836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f23b2d87-7e87-45d4-b510-9bf0ed34114a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:53.352880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:53.353226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f23b2d87-7e87-45d4-b510-9bf0ed34114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:53.353572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.353854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.354124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.354963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:53.355266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:53.356686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:53.383194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 404/808] 10.222.0.36 () {56 vars in 1149 bytes} [Wed May 11 07:25:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:53.386768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:53.422075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 405/809] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:25:53.445382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b2d87-7e87-45d4-b510-9bf0ed34114a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:53.485197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe729d-676b-4781-ab45-fac0f3967fcf None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:53.534781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:53.535588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.535870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.536139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.554618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:53.556076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:53.573709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b2d87-7e87-45d4-b510-9bf0ed34114a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:53.582211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:53.583435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:53.584290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:53.584290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:53.584290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:53.584290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:53.584290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 405/810] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:53.595091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:53.624692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f404bc-77a8-42d9-8b52-c5d8ee8e2cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:53.625909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f404bc-77a8-42d9-8b52-c5d8ee8e2cde None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.627283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f404bc-77a8-42d9-8b52-c5d8ee8e2cde None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.628531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f404bc-77a8-42d9-8b52-c5d8ee8e2cde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.646814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f404bc-77a8-42d9-8b52-c5d8ee8e2cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-19f404bc-77a8-42d9-8b52-c5d8ee8e2cde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:53.655584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:53.656515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:53.657965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:53.668564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 406/811] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:53.678893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f404bc-77a8-42d9-8b52-c5d8ee8e2cde None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:53.787316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f404bc-77a8-42d9-8b52-c5d8ee8e2cde None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:53.824348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:53.824943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.825220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.825489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.826275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:53.826577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:53.828114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:53.838380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 407/812] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:53.844281 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:53.868265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f5443-72b8-42bd-bbae-6846623b3963 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:53.953137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016d93-c149-4c89-8ca3-7fd65baa6094 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:53.954708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:53.955628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.956111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.956593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.957514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:53.958042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:53.959690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:53.988199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 406/813] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:53.989448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:53.989448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:53.989661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:53.990479 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:53.994614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.001843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.003411 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:54.023192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:54.024086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:54.024956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:54.024956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:54.024956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:54.024956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:54.024956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 408/814] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:54.030158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.140642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95518fdd-f813-4001-80ac-965c1249c32c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.176649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.177458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.177774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.178045 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.178760 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:54.179060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.180420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.194221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 409/815] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:54.200372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.271536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c54bd-5e3f-4360-b0fd-024ced8a9fb0 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.311122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335386ba-1fff-4990-9e4d-23a0de76c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.312241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335386ba-1fff-4990-9e4d-23a0de76c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.312823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335386ba-1fff-4990-9e4d-23a0de76c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.313779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335386ba-1fff-4990-9e4d-23a0de76c9b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.314558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840573ce-99f6-4daf-a7ac-8049c11e15d2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.321836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335386ba-1fff-4990-9e4d-23a0de76c9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.323779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335386ba-1fff-4990-9e4d-23a0de76c9b6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-335386ba-1fff-4990-9e4d-23a0de76c9b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:54.342588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:54.343510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:54.344405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:54.344405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:54.344405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:54.344405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:54.344405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:54.344405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:54.344405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:54.344405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:54.344825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 407/816] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:54.346410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e925278-137c-4bef-b08f-9f0603786669 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.346627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e925278-137c-4bef-b08f-9f0603786669 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.346898 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e925278-137c-4bef-b08f-9f0603786669 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.348221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 408/817] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:54.351800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcf07e-0c4a-44c6-ac55-1d8fc0b56d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.352775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf07e-0c4a-44c6-ac55-1d8fc0b56d1c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.352896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e925278-137c-4bef-b08f-9f0603786669 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.353295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf07e-0c4a-44c6-ac55-1d8fc0b56d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.353643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcf07e-0c4a-44c6-ac55-1d8fc0b56d1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.361989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcf07e-0c4a-44c6-ac55-1d8fc0b56d1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.363541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcf07e-0c4a-44c6-ac55-1d8fc0b56d1c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-84dcf07e-0c4a-44c6-ac55-1d8fc0b56d1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:54.379122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:54.381302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 410/818] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:25:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c626-0584-4f93-9357-99ba040d99ca None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.383724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c626-0584-4f93-9357-99ba040d99ca None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.385611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c626-0584-4f93-9357-99ba040d99ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.405311 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0707c626-0584-4f93-9357-99ba040d99ca None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:54.407216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0707c626-0584-4f93-9357-99ba040d99ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:54.475297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e925278-137c-4bef-b08f-9f0603786669 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.501562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 411/819] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:54.501562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c626-0584-4f93-9357-99ba040d99ca None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.538106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.539494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.539924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.540567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.541595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:54.542064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.544772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.558829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 409/820] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:54.560088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.609464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c626-0584-4f93-9357-99ba040d99ca None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.645895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.647011 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.647011 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.647436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.648415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:54.648772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.650432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.665142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372ece7-caf9-46c6-b41c-6c20d5a0b8b9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.673582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 412/821] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:25:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:54.673582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.703557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.704971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.705261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.705550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] PATH_INFO: `/v3/services/network` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.706238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.707687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:54.719916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:54.722234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 07:25:54.724262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:54.731349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 410/822] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:54 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:54.731349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.771381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699acfe-9a2c-49ee-926a-0db3accb23c7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.804827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac945-aeda-488f-bf77-215e8d752aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.805831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac945-aeda-488f-bf77-215e8d752aaf None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.806164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac945-aeda-488f-bf77-215e8d752aaf None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.806446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac945-aeda-488f-bf77-215e8d752aaf None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/044d9c04530347b9a03e9c4c352063bf/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.821986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ac945-aeda-488f-bf77-215e8d752aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=044d9c04530347b9a03e9c4c352063bf, role_id=e09b4b74a6aa4b7a9dc344a03e5c9c35)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.823486 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ac945-aeda-488f-bf77-215e8d752aaf None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.824399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5f924-eeae-44aa-8a54-58e8422956ca None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.838949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 413/823] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:25:54 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/044d9c04530347b9a03e9c4c352063bf/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:25:54.840041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac945-aeda-488f-bf77-215e8d752aaf None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:54.863231 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b047b-da15-4e41-9f96-934614e82559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.863901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b047b-da15-4e41-9f96-934614e82559 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.864181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b047b-da15-4e41-9f96-934614e82559 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.864456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b047b-da15-4e41-9f96-934614e82559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.936682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b047b-da15-4e41-9f96-934614e82559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.939014 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b047b-da15-4e41-9f96-934614e82559 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.948239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac945-aeda-488f-bf77-215e8d752aaf None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:54.984196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:54.985427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:54.985748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:54.986028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:54.986750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] RBAC: Adding query filter params (name=network) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:54.987059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:54.988441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:54.993685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 414/824] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:25:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:54.999683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:55.083379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 411/825] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:25:55.089174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b047b-da15-4e41-9f96-934614e82559 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:55.169959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042d369-bce0-43ab-b5d8-b1f37d14094e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:55.206561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:55.207156 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.207441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.207720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.208430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] RBAC: Adding query filter params (type=network) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:55.208738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:55.210023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b047b-da15-4e41-9f96-934614e82559 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:55.210149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:55.215476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 415/826] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:25:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:55.224617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:55.250894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:55.252001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.252436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.252847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.264589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:55.266381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:55.285890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:55.286972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:55.288018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:55.288018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:55.288018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:55.288018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:55.289890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 412/827] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:55.295926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:55.358321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552f93d-fd37-4839-bfcd-e227565b3afb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:55.395809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35444509-b52f-4b5b-82c6-c31e167f99bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:55.396832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35444509-b52f-4b5b-82c6-c31e167f99bd None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.397319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35444509-b52f-4b5b-82c6-c31e167f99bd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.397848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35444509-b52f-4b5b-82c6-c31e167f99bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.398817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35444509-b52f-4b5b-82c6-c31e167f99bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:55.400381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35444509-b52f-4b5b-82c6-c31e167f99bd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:55.436766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 416/828] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:25:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:55.457657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2c605-d511-40d2-b419-42a4feda07d9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:55.467143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d040-5e27-4142-9844-cb995bb2336e None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.467800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d040-5e27-4142-9844-cb995bb2336e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.468279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d040-5e27-4142-9844-cb995bb2336e None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.470645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 417/829] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:55.476132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa00ac-20f3-4699-b0f1-c82f5a3c7a38 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.476769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa00ac-20f3-4699-b0f1-c82f5a3c7a38 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.477259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa00ac-20f3-4699-b0f1-c82f5a3c7a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.504491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:55.505106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.505392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.505690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.506526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:55.506885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:55.508298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:55.518487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f3aa00ac-20f3-4699-b0f1-c82f5a3c7a38 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:55.520061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f3aa00ac-20f3-4699-b0f1-c82f5a3c7a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:55.522457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 413/830] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:55.530316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:55.625576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 418/831] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:55.625576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed5375-419d-469f-94b8-a364f9ee8d29 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.625576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed5375-419d-469f-94b8-a364f9ee8d29 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.625576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed5375-419d-469f-94b8-a364f9ee8d29 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.629701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 419/832] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:55.632122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ad78-71e1-4b11-9227-33ba7b8c8873 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.632418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ad78-71e1-4b11-9227-33ba7b8c8873 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.632707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ad78-71e1-4b11-9227-33ba7b8c8873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.652515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-5c11ad78-71e1-4b11-9227-33ba7b8c8873 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:55.654282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5c11ad78-71e1-4b11-9227-33ba7b8c8873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:55.681185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0ebf7-4395-4340-8b61-ba42facc023a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:55.721501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:55.725194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.725194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.725194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.733507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 420/833] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:55.734277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ad78-71e1-4b11-9227-33ba7b8c8873 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:55.735217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:55.736983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:55.755010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:55.755926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:55.756799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:55.756799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:55.756799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:55.756799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:55.756799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:55.756799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:55.756799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:55.756799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:55.759392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 414/834] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:55.765364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:55.851797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ad78-71e1-4b11-9227-33ba7b8c8873 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:55.876812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038189-1dff-49f9-a394-8897337f6acd None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:55.888143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8283b-b8cf-45bd-9411-b5fdda211ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:55.888937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8283b-b8cf-45bd-9411-b5fdda211ecc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.889224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8283b-b8cf-45bd-9411-b5fdda211ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.889499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8283b-b8cf-45bd-9411-b5fdda211ecc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.899851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8283b-b8cf-45bd-9411-b5fdda211ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-21a8283b-b8cf-45bd-9411-b5fdda211ecc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:55.908138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:55.909046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:55.909901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 421/835] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:55.910585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8283b-b8cf-45bd-9411-b5fdda211ecc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:55.915568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:55.916228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:55.916508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:55.916781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:55.917583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:55.917897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:55.919389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:55.931005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 415/836] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:55.931669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:56.011687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8283b-b8cf-45bd-9411-b5fdda211ecc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.031268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf88e0-2ccf-46ca-bbd5-548a63735d2c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.048125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.048924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.049206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.049480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.050159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.051525 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:56.063959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:56.064932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:56.065772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 422/837] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:56.066550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:56.067742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.068060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.068432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.068722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.069456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:56.069793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.071408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.084219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 416/838] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:25:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:56.084219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:56.171541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27162f-e34e-4cc3-88bd-815fd8b9d3bb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.180551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25a701-586f-4202-93c1-f40612e5189f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.205975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.206631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.206920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.207195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.208014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=d42155dc7b5f42b79943f99952448202) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:56.208325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.209776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.215342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 423/839] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:56 2022] GET /identity/v3/role_assignments?user.id=d42155dc7b5f42b79943f99952448202&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=de114c58fdc8476ebab657e6f9359155 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:56.215822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.216109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:56.216891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.217168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.217437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.218169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:56.218474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.219891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.232031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 417/840] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:56.238677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:56.355418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb9bb9-f436-49bf-af07-9ac67f7644c7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.362439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711e0b0-3fbd-4236-bf02-33513f7ceb1e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.393098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.393963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.394251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.394529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.405836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.406166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.406876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.407157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.407343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.407443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.408311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:56.408618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.410185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.417631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 418/841] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:25:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:56.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:56.429415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:56.430875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:56.430875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:56.430875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:56.430875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:56.430875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 424/842] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:56.435720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:56.554810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c4020-156f-46d0-8d22-e59c1b9b2c50 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.591567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.592246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.592531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.592810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.593702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:56.594020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.595449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.608210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 419/843] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:56.614136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:56.718959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c201d-9807-42ac-82c2-df24e37f59b4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.753700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.754508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.754791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.755064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.763016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.764468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:56.778962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:56.781148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:56.784096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 425/844] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:25:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:56.789575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:56.888916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2a945-beec-4572-8233-58a58267f111 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:56.924081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:56.924811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:56.925098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:56.925377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:56.926284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:56.926595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:56.928026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:56.945978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 420/845] 10.222.0.36 () {56 vars in 1135 bytes} [Wed May 11 07:25:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:56.951295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:57.053439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070f7b-68e2-437e-aec2-ce622b5e9680 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:57.087536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d728d4-09c4-43e1-9e35-e6c35d805b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:57.088098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d728d4-09c4-43e1-9e35-e6c35d805b57 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.088382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d728d4-09c4-43e1-9e35-e6c35d805b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.088659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d728d4-09c4-43e1-9e35-e6c35d805b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.160717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d728d4-09c4-43e1-9e35-e6c35d805b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:57.162214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d728d4-09c4-43e1-9e35-e6c35d805b57 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:57.260646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 426/846] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:25:57.266811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:57.371802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0f99e-3acd-430e-aa0c-43dc06357263 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:57.405480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63385a6a-b747-4acf-869f-174b4ee98b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:57.406299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63385a6a-b747-4acf-869f-174b4ee98b53 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.406611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63385a6a-b747-4acf-869f-174b4ee98b53 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.407423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63385a6a-b747-4acf-869f-174b4ee98b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.417618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63385a6a-b747-4acf-869f-174b4ee98b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:57.419034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63385a6a-b747-4acf-869f-174b4ee98b53 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-63385a6a-b747-4acf-869f-174b4ee98b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:57.438504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:57.440631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:57.442956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:57.442956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:57.442956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:57.442956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:57.442956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 421/847] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:57.445565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d728d4-09c4-43e1-9e35-e6c35d805b57 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:57.481587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d08bc-e78f-4f70-a7df-61956dd9cd20 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.481587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d08bc-e78f-4f70-a7df-61956dd9cd20 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.481587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d08bc-e78f-4f70-a7df-61956dd9cd20 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.483621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 422/848] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:57.488884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d321-f475-435d-b05d-afc1767eb013 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.489271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d321-f475-435d-b05d-afc1767eb013 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.489673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7d321-f475-435d-b05d-afc1767eb013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.508864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7eb7d321-f475-435d-b05d-afc1767eb013 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:57.510690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7eb7d321-f475-435d-b05d-afc1767eb013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:57.555670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d728d4-09c4-43e1-9e35-e6c35d805b57 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:57.597701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 423/849] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:25:57.605827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:57.606499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.606780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.607053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.607782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:57.608090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:57.609459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:57.621211 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 427/850] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:57.621381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d321-f475-435d-b05d-afc1767eb013 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:57.626911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:57.726145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edae6c9-b109-4983-8266-a3b3078a0257 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:57.746967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7d321-f475-435d-b05d-afc1767eb013 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:57.759554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:57.760353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.760637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.760913 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.768393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:57.769880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:57.784210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:57.786226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:57.788277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 428/851] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:57.789425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c304-bf61-40bc-8472-15e16aa468dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:57.789425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c304-bf61-40bc-8472-15e16aa468dd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.789425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c304-bf61-40bc-8472-15e16aa468dd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.789425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271c304-bf61-40bc-8472-15e16aa468dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.797967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:57.801330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271c304-bf61-40bc-8472-15e16aa468dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-b271c304-bf61-40bc-8472-15e16aa468dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:25:57.809569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:57.811375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:57.812755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 424/852] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:57.818027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c304-bf61-40bc-8472-15e16aa468dd None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:57.900974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7032c-141f-4baf-bd85-3fc9a39f9c8f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:57.934759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:57.935612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.935999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.936378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.937266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:57.938506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:57.940144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:57.942183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271c304-bf61-40bc-8472-15e16aa468dd None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:57.957081 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 429/853] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:57.958216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:57.980737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:57.981638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:57.981927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:57.982202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:57.983117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:57.983427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:57.985976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:58.001631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 425/854] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:25:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:58.005766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:58.076335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f2f69-659e-4ef3-a080-68cb2bf41728 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:58.116620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87882b9-8fae-4717-b8b7-13520a86323b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:58.118562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:58.119299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.119657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.120006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.120912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=0aa4d2cc79404c2c8fbc1ff8868b386a) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:58.121299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:58.122865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:58.137854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 430/855] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:57 2022] GET /identity/v3/role_assignments?user.id=0aa4d2cc79404c2c8fbc1ff8868b386a&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=de114c58fdc8476ebab657e6f9359155 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:58.153191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:58.154068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.154398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.154679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.167237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:58.168841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:58.189152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:58.190520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:58.192489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:58.192489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:58.192489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:58.192489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:58.192489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 426/856] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:25:58.196579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:58.311088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d920f-2afc-4895-8578-bb9d44d64754 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:58.349084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:58.349781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.350069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.350345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.351078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:58.351388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:58.352757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:58.366422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 431/857] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:58.371977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:58.477283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8badd7-06cc-4a91-9271-023474d1821c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:58.514790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585a050-badb-4668-aca9-76be31b2647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:58.515763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a050-badb-4668-aca9-76be31b2647b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.516100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a050-badb-4668-aca9-76be31b2647b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.516377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a050-badb-4668-aca9-76be31b2647b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.525307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585a050-badb-4668-aca9-76be31b2647b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:58.526832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585a050-badb-4668-aca9-76be31b2647b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-c585a050-badb-4668-aca9-76be31b2647b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:25:58.543421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:58.544428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:58.545348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 427/858] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:25:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:58.551406 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:58.594788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64efbac-f01b-4917-9e73-0d48bc55fa22 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.595092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64efbac-f01b-4917-9e73-0d48bc55fa22 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.595305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64efbac-f01b-4917-9e73-0d48bc55fa22 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.596920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 428/859] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:25:58.602005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810406-e803-4d4a-9074-0aea040acf49 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.602293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810406-e803-4d4a-9074-0aea040acf49 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.602571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2810406-e803-4d4a-9074-0aea040acf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.622682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d2810406-e803-4d4a-9074-0aea040acf49 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:58.624176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d2810406-e803-4d4a-9074-0aea040acf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:58.659107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b837b8d-9faa-4df3-b44e-7021c10ba146 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:58.698974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 429/860] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:25:58.699380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:58.700062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.700345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.700623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.701463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:58.701761 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc525-7644-4889-adab-75e2fdf05075 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.701866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:58.702333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc525-7644-4889-adab-75e2fdf05075 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.702805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc525-7644-4889-adab-75e2fdf05075 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.703249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:58.705299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 430/861] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:25:58.714827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204576-3f9d-4229-9b8f-62d85d297d3a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.715117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204576-3f9d-4229-9b8f-62d85d297d3a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.715400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76204576-3f9d-4229-9b8f-62d85d297d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.724384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 432/862] 10.222.0.36 () {56 vars in 1149 bytes} [Wed May 11 07:25:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:58.727813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:58.735092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-76204576-3f9d-4229-9b8f-62d85d297d3a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:25:58.736257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-76204576-3f9d-4229-9b8f-62d85d297d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:25:58.805354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 431/863] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:25:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:25:58.806756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76204576-3f9d-4229-9b8f-62d85d297d3a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:58.826857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05559-2d06-4f5e-9f27-b56521783efb None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:58.860881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:58.861627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.861908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.862179 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.862828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:58.864181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:58.878176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:58.879079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:58.879923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 433/864] 10.222.0.36 () {56 vars in 1132 bytes} [Wed May 11 07:25:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:58.880753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:58.916973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76204576-3f9d-4229-9b8f-62d85d297d3a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:58.950183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655a94-5104-4154-baca-6b3742a9e000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:58.950894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655a94-5104-4154-baca-6b3742a9e000 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:58.951179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655a94-5104-4154-baca-6b3742a9e000 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:58.951455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be655a94-5104-4154-baca-6b3742a9e000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:58.976513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6f1f7-4571-44ba-b5f8-2ed03c88a127 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:59.009268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51663ad1-56fc-4909-b678-491a3320b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:59.009971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663ad1-56fc-4909-b678-491a3320b52f None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:59.010262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663ad1-56fc-4909-b678-491a3320b52f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:59.010531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663ad1-56fc-4909-b678-491a3320b52f None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:59.011246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51663ad1-56fc-4909-b678-491a3320b52f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.012619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51663ad1-56fc-4909-b678-491a3320b52f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:59.017875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be655a94-5104-4154-baca-6b3742a9e000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.019501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be655a94-5104-4154-baca-6b3742a9e000 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:59.030934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 434/865] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:25:58 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:25:59.031836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51663ad1-56fc-4909-b678-491a3320b52f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:59.135420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 432/866] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:25:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:25:59.145946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51663ad1-56fc-4909-b678-491a3320b52f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:59.146644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655a94-5104-4154-baca-6b3742a9e000 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:59.184594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:59.185673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:59.186185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:59.186662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:59.188365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:59.188885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.190518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:59.196736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 435/867] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:25:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:59.201773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:59.264744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be655a94-5104-4154-baca-6b3742a9e000 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:59.305506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:59.306675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:59.306956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:59.307245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:59.320660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc58787-b931-4d28-8da7-45e693863e84 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:59.323407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.325673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:25:59.347547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:59.348453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:59.349323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:25:59.349323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:25:59.349323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:25:59.349323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:25:59.353438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 433/868] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:59.354668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:59.365444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:59.366489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:59.367356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:59.367842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:59.369272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:59.369958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.371782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:59.379031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 436/869] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:25:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:25:59.467986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4135a9-b92e-4221-9969-8858975adcb7 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:59.505533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:59.506246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:59.506525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:59.506797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:59.507536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:59.507842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.510275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:59.532554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 434/870] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:59.534668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:59.633901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b35eb0-4bb4-4767-a47e-2cda43e44065 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:59.667102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:59.667947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:59.668229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:59.668500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:59.675231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.676662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:25:59.690929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:25:59.691842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:25:59.692728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:25:59.692728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:25:59.692728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:25:59.692728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:25:59.692728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:25:59.692728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:25:59.692728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:25:59.692728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:25:59.696245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 437/871] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:25:59.698191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:59.798058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc6e3-d931-475d-a59d-59fb93ee4d6b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:59.832450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fecc7-de5c-4485-9cd7-1cd8c8b5bea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:59.833234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fecc7-de5c-4485-9cd7-1cd8c8b5bea7 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:59.833403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fecc7-de5c-4485-9cd7-1cd8c8b5bea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:59.833656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fecc7-de5c-4485-9cd7-1cd8c8b5bea7 None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:59.834441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fecc7-de5c-4485-9cd7-1cd8c8b5bea7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:59.834749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fecc7-de5c-4485-9cd7-1cd8c8b5bea7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.836169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fecc7-de5c-4485-9cd7-1cd8c8b5bea7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:25:59.853080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 435/872] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:25:59.854673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:25:59.960077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ca0f-9922-4fee-a0c7-d6e760b57fdd None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:25:59.994254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c52128-7da6-4d22-82ed-163b18e65509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:25:59.994919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52128-7da6-4d22-82ed-163b18e65509 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:25:59.995204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52128-7da6-4d22-82ed-163b18e65509 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:25:59.995480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52128-7da6-4d22-82ed-163b18e65509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:25:59.996307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c52128-7da6-4d22-82ed-163b18e65509 None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=044d9c04530347b9a03e9c4c352063bf) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:25:59.996628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c52128-7da6-4d22-82ed-163b18e65509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:25:59.998188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c52128-7da6-4d22-82ed-163b18e65509 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:00.005043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 438/873] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:25:59 2022] GET /identity/v3/role_assignments?user.id=044d9c04530347b9a03e9c4c352063bf&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:00.530270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2ad5-9ce5-4648-a47d-bb5d1e8bf215 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:00.530596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2ad5-9ce5-4648-a47d-bb5d1e8bf215 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:00.530862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2ad5-9ce5-4648-a47d-bb5d1e8bf215 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:00.532981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 436/874] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:00.539454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1455c2-3e29-4b3b-9c52-7e46ce0bbe5f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:00.539762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1455c2-3e29-4b3b-9c52-7e46ce0bbe5f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:00.540008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1455c2-3e29-4b3b-9c52-7e46ce0bbe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:00.559577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-fa1455c2-3e29-4b3b-9c52-7e46ce0bbe5f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:00.560818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-fa1455c2-3e29-4b3b-9c52-7e46ce0bbe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:00.627465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 439/875] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:00.649287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a2ad5-9ce5-4648-a47d-bb5d1e8bf215 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:00.749005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a2ad5-9ce5-4648-a47d-bb5d1e8bf215 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:00.782206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:00.783010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:00.783294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:00.783570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:00.784225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:00.785619 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:00.798186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:00.800579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:00.802775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 437/876] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:00.809586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1455c2-3e29-4b3b-9c52-7e46ce0bbe5f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:00.909081 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1455c2-3e29-4b3b-9c52-7e46ce0bbe5f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:00.943172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11eda3-e181-47d8-a68a-09ae28cf158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:00.943748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11eda3-e181-47d8-a68a-09ae28cf158e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:00.944030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11eda3-e181-47d8-a68a-09ae28cf158e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:00.944306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11eda3-e181-47d8-a68a-09ae28cf158e None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:00.945017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11eda3-e181-47d8-a68a-09ae28cf158e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:00.945338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11eda3-e181-47d8-a68a-09ae28cf158e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:00.946767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11eda3-e181-47d8-a68a-09ae28cf158e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:00.951735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 440/877] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:00.957518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:01.055901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90b8d4-2cc9-4fbf-ad09-bfee9cf4ffd8 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:01.089164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd791bac-2d72-40c1-9fdb-8da711159726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:01.089853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791bac-2d72-40c1-9fdb-8da711159726 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:01.090134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791bac-2d72-40c1-9fdb-8da711159726 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:01.090408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791bac-2d72-40c1-9fdb-8da711159726 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:01.091105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd791bac-2d72-40c1-9fdb-8da711159726 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:01.091410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd791bac-2d72-40c1-9fdb-8da711159726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:01.092763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd791bac-2d72-40c1-9fdb-8da711159726 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:01.098239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 438/878] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:01.427558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8a639-b8f3-4e9e-8683-7ba5e3b37654 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:01.427953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8a639-b8f3-4e9e-8683-7ba5e3b37654 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:01.428125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8a639-b8f3-4e9e-8683-7ba5e3b37654 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:01.429712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 441/879] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:01.435022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d818-f7e3-41c6-8108-006ddadb728c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:01.435309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d818-f7e3-41c6-8108-006ddadb728c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:01.435581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995d818-f7e3-41c6-8108-006ddadb728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:01.456887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e995d818-f7e3-41c6-8108-006ddadb728c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:01.458128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e995d818-f7e3-41c6-8108-006ddadb728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:01.526842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 439/880] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:01.549073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8a639-b8f3-4e9e-8683-7ba5e3b37654 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:01.654641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8a639-b8f3-4e9e-8683-7ba5e3b37654 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:01.688680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3d832-5b84-4457-b457-01dbe1197fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:01.689445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3d832-5b84-4457-b457-01dbe1197fc4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:01.689752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3d832-5b84-4457-b457-01dbe1197fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:01.690025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3d832-5b84-4457-b457-01dbe1197fc4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:01.690670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3d832-5b84-4457-b457-01dbe1197fc4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:01.692033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3d832-5b84-4457-b457-01dbe1197fc4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-07f3d832-5b84-4457-b457-01dbe1197fc4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:01.703862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:01.706171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:01.708351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 442/881] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:26:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:01.712718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d818-f7e3-41c6-8108-006ddadb728c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:01.713237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3695f-9939-4363-80f3-e2be52e55197 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:01.713524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3695f-9939-4363-80f3-e2be52e55197 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:01.713828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3695f-9939-4363-80f3-e2be52e55197 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:01.715246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 443/882] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:01.720885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875eea-78f8-4b30-adbf-32f8ba74099f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:01.721170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875eea-78f8-4b30-adbf-32f8ba74099f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:01.721447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb875eea-78f8-4b30-adbf-32f8ba74099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:01.741886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-fb875eea-78f8-4b30-adbf-32f8ba74099f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:01.743473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-fb875eea-78f8-4b30-adbf-32f8ba74099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:01.821675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995d818-f7e3-41c6-8108-006ddadb728c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:01.825609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 444/883] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:01.847906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb875eea-78f8-4b30-adbf-32f8ba74099f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:01.864375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:01.865349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:01.865862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:01.866418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:01.867328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:01.867906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:01.869483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:01.874993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 440/884] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:26:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:01.881276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:01.979578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb875eea-78f8-4b30-adbf-32f8ba74099f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:01.985575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32163-5c24-4d80-adb0-8205350add97 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:02.019186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a040d-e642-424a-b25b-d1d861eee437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:02.020190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a040d-e642-424a-b25b-d1d861eee437 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.020696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a040d-e642-424a-b25b-d1d861eee437 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.021163 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a040d-e642-424a-b25b-d1d861eee437 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.022101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a040d-e642-424a-b25b-d1d861eee437 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:02.023827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a040d-e642-424a-b25b-d1d861eee437 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:02.025722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:02.026384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.026829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.027111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.028375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:02.028774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:02.030426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:02.041446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 441/885] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:26:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:02.043656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:02.053639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 445/886] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:26:01 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:26:02.159384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21f086-3512-4000-9e47-8a7ef65c1b6b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:02.207463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063f20-7b90-4d28-9b88-998fb4d7a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:02.208722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063f20-7b90-4d28-9b88-998fb4d7a311 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.209212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063f20-7b90-4d28-9b88-998fb4d7a311 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.209769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063f20-7b90-4d28-9b88-998fb4d7a311 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.210824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063f20-7b90-4d28-9b88-998fb4d7a311 None admin] RBAC: Adding query filter params (interface=public, service_id=eff4c85f457741c3945a65135f933346, region_id=RegionOne) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:02.211382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063f20-7b90-4d28-9b88-998fb4d7a311 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:02.213041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063f20-7b90-4d28-9b88-998fb4d7a311 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:02.222218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 442/887] 10.222.0.36 () {56 vars in 1251 bytes} [Wed May 11 07:26:02 2022] GET /identity/v3/endpoints?service_id=eff4c85f457741c3945a65135f933346&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:02.230751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a040d-e642-424a-b25b-d1d861eee437 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:02.335928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a040d-e642-424a-b25b-d1d861eee437 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:02.369995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742b40-d133-416b-8884-d42353b3ba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:02.371002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742b40-d133-416b-8884-d42353b3ba48 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.371476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742b40-d133-416b-8884-d42353b3ba48 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.371979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742b40-d133-416b-8884-d42353b3ba48 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.372910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742b40-d133-416b-8884-d42353b3ba48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:02.374578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742b40-d133-416b-8884-d42353b3ba48 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:02.380055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433203e1-b04c-4899-9ef0-109d5d56bfbe None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.380349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433203e1-b04c-4899-9ef0-109d5d56bfbe None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.380631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433203e1-b04c-4899-9ef0-109d5d56bfbe None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.381645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 446/888] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:26:02 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:26:02.382130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 443/889] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:02.387001 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e6ce-5362-489a-8e08-f220eed679cd None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.387286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e6ce-5362-489a-8e08-f220eed679cd None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.387560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04e6ce-5362-489a-8e08-f220eed679cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.405568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1f04e6ce-5362-489a-8e08-f220eed679cd None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:02.407452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1f04e6ce-5362-489a-8e08-f220eed679cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:02.478265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 447/890] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:02.507213 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433203e1-b04c-4899-9ef0-109d5d56bfbe None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:02.619632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433203e1-b04c-4899-9ef0-109d5d56bfbe None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:02.652532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0caa1f-7a69-4790-ad20-1e24d40f018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:02.653403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0caa1f-7a69-4790-ad20-1e24d40f018c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.653714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0caa1f-7a69-4790-ad20-1e24d40f018c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.653992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0caa1f-7a69-4790-ad20-1e24d40f018c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.664704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0caa1f-7a69-4790-ad20-1e24d40f018c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-1e0caa1f-7a69-4790-ad20-1e24d40f018c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:02.673434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:02.674392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:02.675268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 444/891] 10.222.0.36 () {56 vars in 1120 bytes} [Wed May 11 07:26:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:02.682387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04e6ce-5362-489a-8e08-f220eed679cd None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:02.779839 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04e6ce-5362-489a-8e08-f220eed679cd None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:02.814876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:02.815887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.816375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.816868 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.817857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:02.818386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:02.820033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:02.833408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 448/892] 10.222.0.36 () {56 vars in 1115 bytes} [Wed May 11 07:26:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:02.838906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0caa1f-7a69-4790-ad20-1e24d40f018c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:02.939818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0caa1f-7a69-4790-ad20-1e24d40f018c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:02.976065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:02.977215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:02.977725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:02.978220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:02.989366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:02.991600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:03.009826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:03.010739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:03.011643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:03.011643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:03.011643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:03.011643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:03.013916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 445/893] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:03.019881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:03.119586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca311282-8206-4411-8ad7-e92f2100c297 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:03.152191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:03.153188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:03.153704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:03.154206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:03.155177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:03.155686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:03.157821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:03.170891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 449/894] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:03.176419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:03.289447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04845a6-3e2c-4bb3-8a9b-eb55bb288755 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:03.323268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6e0ea-3087-4c87-8025-dbe32c3df788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:03.324088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e0ea-3087-4c87-8025-dbe32c3df788 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:03.324368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e0ea-3087-4c87-8025-dbe32c3df788 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:03.324645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6e0ea-3087-4c87-8025-dbe32c3df788 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:03.332534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6e0ea-3087-4c87-8025-dbe32c3df788 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:03.334088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6e0ea-3087-4c87-8025-dbe32c3df788 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-72d6e0ea-3087-4c87-8025-dbe32c3df788 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:26:03.349881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:03.350836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:03.351903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 446/895] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:26:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:03.356979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:03.387489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc1e3-8ffd-4109-a367-ac1da35431ae None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:03.387676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc1e3-8ffd-4109-a367-ac1da35431ae None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:03.387952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fc1e3-8ffd-4109-a367-ac1da35431ae None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:03.389446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 447/896] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:03.396674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b438d-b8ae-4d4b-87ef-eed604d5d552 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:03.396964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b438d-b8ae-4d4b-87ef-eed604d5d552 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:03.397236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b438d-b8ae-4d4b-87ef-eed604d5d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:03.417110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7c8b438d-b8ae-4d4b-87ef-eed604d5d552 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:03.418482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7c8b438d-b8ae-4d4b-87ef-eed604d5d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:03.474679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e84143-251a-47cb-a434-675cfd153cfd None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:03.508488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:03.509274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:03.509683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:03.510051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:03.510997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:03.511402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:03.512914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:03.517711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 448/897] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:03.532923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 450/898] 10.222.0.36 () {56 vars in 1149 bytes} [Wed May 11 07:26:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:03.538557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b438d-b8ae-4d4b-87ef-eed604d5d552 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:03.546614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:03.649934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b438d-b8ae-4d4b-87ef-eed604d5d552 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:03.666198 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c62d25-e7bd-4179-b383-71ca3080243b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:03.686813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353779-9bcd-4f8b-b9c3-e87c1b3eacaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:03.688627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353779-9bcd-4f8b-b9c3-e87c1b3eacaf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:03.689066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353779-9bcd-4f8b-b9c3-e87c1b3eacaf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:03.689822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353779-9bcd-4f8b-b9c3-e87c1b3eacaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:03.706168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f93aba-e938-4ea9-ac6e-cfaa8124a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:03.707004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f93aba-e938-4ea9-ac6e-cfaa8124a5fd None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:03.707367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f93aba-e938-4ea9-ac6e-cfaa8124a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:03.707704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f93aba-e938-4ea9-ac6e-cfaa8124a5fd None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:03.708515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f93aba-e938-4ea9-ac6e-cfaa8124a5fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:03.710348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f93aba-e938-4ea9-ac6e-cfaa8124a5fd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:03.738114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 451/899] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:26:03 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:03.770409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353779-9bcd-4f8b-b9c3-e87c1b3eacaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:03.772272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e353779-9bcd-4f8b-b9c3-e87c1b3eacaf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:03.889742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 449/900] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:03 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 07:26:03.895516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f93aba-e938-4ea9-ac6e-cfaa8124a5fd None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:04.008918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f93aba-e938-4ea9-ac6e-cfaa8124a5fd None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:04.042074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:04.043127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.043539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.043817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.054249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:04.055689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:04.073625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:04.074543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:04.075407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:04.075407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:04.075407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:04.075407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:04.075407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 452/901] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:04.084142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353779-9bcd-4f8b-b9c3-e87c1b3eacaf None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:04.183406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e353779-9bcd-4f8b-b9c3-e87c1b3eacaf None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:04.218652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e064c-0ea0-40a8-aafa-761166ece927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:04.219910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e064c-0ea0-40a8-aafa-761166ece927 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.220192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e064c-0ea0-40a8-aafa-761166ece927 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.220461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e064c-0ea0-40a8-aafa-761166ece927 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.221209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e064c-0ea0-40a8-aafa-761166ece927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:04.221517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e064c-0ea0-40a8-aafa-761166ece927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:04.222981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e064c-0ea0-40a8-aafa-761166ece927 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:04.236399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 450/902] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:04.242089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:04.346707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3623f-6191-49e9-8406-50055e6486b6 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:04.383224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:04.384415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.384901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.385395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.393147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:04.394866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:26:04.408994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:04.409932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:04.410811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:26:04.410811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:26:04.410811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:26:04.410811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:26:04.410811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:26:04.410811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:26:04.410811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:04.410811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:04.411238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddedf4-6670-4ada-8b3d-3072bfb37f70 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.411238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddedf4-6670-4ada-8b3d-3072bfb37f70 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.411238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddedf4-6670-4ada-8b3d-3072bfb37f70 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.411932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 451/903] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:04.413364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 453/904] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:04.417575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248187f-85bb-4f72-b9c9-14b23bb41a76 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.417575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248187f-85bb-4f72-b9c9-14b23bb41a76 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.417575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248187f-85bb-4f72-b9c9-14b23bb41a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.419573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:04.433764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1248187f-85bb-4f72-b9c9-14b23bb41a76 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:04.435261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1248187f-85bb-4f72-b9c9-14b23bb41a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:04.529687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 452/905] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:04.537253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d158e-d997-4fec-9dd6-eac9ff607c33 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:04.551344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248187f-85bb-4f72-b9c9-14b23bb41a76 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:04.583372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:04.584605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.585244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.586054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.587298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:04.587821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:04.590286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:04.607119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 454/906] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:04.615242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:04.669908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248187f-85bb-4f72-b9c9-14b23bb41a76 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:04.708233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:04.709482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.710015 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.710521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.711392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:04.712978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:04.725824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:04.726756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:26:04.727600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:04.730552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 453/907] 10.222.0.36 () {56 vars in 1132 bytes} [Wed May 11 07:26:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:04.736791 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:04.739040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d04f6-170b-42b0-9375-6bc4e8a1b32e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:04.772756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe52ab-d6c7-4d6d-b9dc-b0999d5aa9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:04.773434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe52ab-d6c7-4d6d-b9dc-b0999d5aa9c0 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.773743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe52ab-d6c7-4d6d-b9dc-b0999d5aa9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.774025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe52ab-d6c7-4d6d-b9dc-b0999d5aa9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.774840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe52ab-d6c7-4d6d-b9dc-b0999d5aa9c0 None admin] RBAC: Adding query filter params (role.id=84b7ff3b93fb4ea697f86076cfbb0034, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=044d9c04530347b9a03e9c4c352063bf) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:04.775154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe52ab-d6c7-4d6d-b9dc-b0999d5aa9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:04.776580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe52ab-d6c7-4d6d-b9dc-b0999d5aa9c0 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:04.789579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 455/908] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:04 2022] GET /identity/v3/role_assignments?user.id=044d9c04530347b9a03e9c4c352063bf&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=84b7ff3b93fb4ea697f86076cfbb0034 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:04.849423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20cd06-692c-479e-82b7-9400c95d4fd4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:04.852167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee89a8b-30b4-48df-b67b-290f7befb679 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.852453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee89a8b-30b4-48df-b67b-290f7befb679 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.852725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee89a8b-30b4-48df-b67b-290f7befb679 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.857592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 456/909] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:04.860869 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a49a-e75b-46b9-b093-b6f9c33e58e0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.861406 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a49a-e75b-46b9-b093-b6f9c33e58e0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.861975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a49a-e75b-46b9-b093-b6f9c33e58e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.879675 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b559a49a-e75b-46b9-b093-b6f9c33e58e0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:04.880886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b559a49a-e75b-46b9-b093-b6f9c33e58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:04.897268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:04.898663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:04.899158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:04.899833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:04.901224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:04.902035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:04.904185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:04.911476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 454/910] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:04.917661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:04.980582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 457/911] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:05.005017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559a49a-e75b-46b9-b093-b6f9c33e58e0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:05.034386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11274a62-4ff4-46a1-a336-904114dec4b2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:05.080804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:05.081788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:05.082084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:05.082368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:05.083081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:05.083393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:05.084743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:05.091733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 455/912] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:05.096279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:05.129750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559a49a-e75b-46b9-b093-b6f9c33e58e0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:05.179333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:05.180586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:05.181084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:05.181515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:05.183279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:05.186069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:05.198738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f3a4-5fe8-48a3-b7f3-439da4b324a9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:05.207914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:05.209147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 07:26:05.210221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:05.217036 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 458/913] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:26:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:05.218959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:05.246218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:05.247254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:05.247731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:05.248199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:05.249191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] RBAC: Adding query filter params (interface=public, service_id=a481cfdc05af4015943bcd2f4f89a6a5, region_id=RegionOne) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:05.249744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:05.251867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:05.261595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 456/914] 10.222.0.36 () {56 vars in 1251 bytes} [Wed May 11 07:26:05 2022] GET /identity/v3/endpoints?service_id=a481cfdc05af4015943bcd2f4f89a6a5&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:05.262740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:05.341697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa1793-40c5-43d6-bd69-827dd65a317c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:05.366303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2608a-34d9-4f39-bc96-a5cc220b1fe9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:05.384901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:05.385499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:05.385813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:05.386090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:05.386799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:05.387108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:05.388950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:05.397687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 459/915] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:26:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:05.401974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:05.405880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f197c3-b436-4fe7-ada7-d961e4871ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:05.406866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f197c3-b436-4fe7-ada7-d961e4871ae2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:05.407341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f197c3-b436-4fe7-ada7-d961e4871ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:05.407804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f197c3-b436-4fe7-ada7-d961e4871ae2 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:05.408673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f197c3-b436-4fe7-ada7-d961e4871ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:05.410289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f197c3-b436-4fe7-ada7-d961e4871ae2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:05.417086 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 457/916] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:26:05 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:26:05.514003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e76501-d459-4167-9747-25848ddafba5 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:05.553626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b8f43-2c50-4f5c-b557-1fa2f0de7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:05.554316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8f43-2c50-4f5c-b557-1fa2f0de7ddb None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:05.554601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8f43-2c50-4f5c-b557-1fa2f0de7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:05.554879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b8f43-2c50-4f5c-b557-1fa2f0de7ddb None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:05.555603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8f43-2c50-4f5c-b557-1fa2f0de7ddb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:05.555914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8f43-2c50-4f5c-b557-1fa2f0de7ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:05.557318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b8f43-2c50-4f5c-b557-1fa2f0de7ddb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:05.564178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 460/917] 10.222.0.36 () {56 vars in 1114 bytes} [Wed May 11 07:26:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:05.569853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f197c3-b436-4fe7-ada7-d961e4871ae2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:05.678175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f197c3-b436-4fe7-ada7-d961e4871ae2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:05.711824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714aa10-488a-457b-bc10-8dab512d7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:05.712861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714aa10-488a-457b-bc10-8dab512d7624 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:05.713337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714aa10-488a-457b-bc10-8dab512d7624 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:05.713832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714aa10-488a-457b-bc10-8dab512d7624 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:05.714768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714aa10-488a-457b-bc10-8dab512d7624 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:05.716314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714aa10-488a-457b-bc10-8dab512d7624 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:05.739159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 458/918] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:26:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:06.063616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a672f6-19b2-47a7-8a44-f74d672de283 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:06.063875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a672f6-19b2-47a7-8a44-f74d672de283 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:06.064147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a672f6-19b2-47a7-8a44-f74d672de283 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:06.065725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 461/919] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:06.071302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe76f-ba6b-43c4-9df7-dc8fdeb9335b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:06.071597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe76f-ba6b-43c4-9df7-dc8fdeb9335b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:06.071878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe76f-ba6b-43c4-9df7-dc8fdeb9335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:06.089087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1f3fe76f-ba6b-43c4-9df7-dc8fdeb9335b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:06.090299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1f3fe76f-ba6b-43c4-9df7-dc8fdeb9335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:06.167677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 459/920] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:06.194286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a672f6-19b2-47a7-8a44-f74d672de283 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:06.314848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a672f6-19b2-47a7-8a44-f74d672de283 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:06.348967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:06.349842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:06.350126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:06.350395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:06.351097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:06.352462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:06.364967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:06.366085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:06.366978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:06.371277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 462/921] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:06.372630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fe76f-ba6b-43c4-9df7-dc8fdeb9335b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:06.475285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fe76f-ba6b-43c4-9df7-dc8fdeb9335b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:06.515275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:06.516918 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:06.517406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:06.517919 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:06.518828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:06.519336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:06.520895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:06.526228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 460/922] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:06.537567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:06.660248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438fb99-2206-4226-b3ed-ffa295a56e29 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:06.694754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:06.695438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:06.695724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:06.695999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:06.696720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:06.697038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:06.698552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:06.705175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 463/923] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:06.710883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:06.806561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642341ac-1947-419d-b0a4-566cd69ba8a0 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:06.840441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c25557-0527-44fc-8ac5-74f36247e84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:06.841096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c25557-0527-44fc-8ac5-74f36247e84b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:06.841378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c25557-0527-44fc-8ac5-74f36247e84b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:06.841694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c25557-0527-44fc-8ac5-74f36247e84b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:06.842457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c25557-0527-44fc-8ac5-74f36247e84b None admin] RBAC: Adding query filter params (interface=public, service_id=00f289a358144410b4839e756e9be381, region_id=RegionOne) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:06.842764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c25557-0527-44fc-8ac5-74f36247e84b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:06.844159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c25557-0527-44fc-8ac5-74f36247e84b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:06.853589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 461/924] 10.222.0.36 () {56 vars in 1251 bytes} [Wed May 11 07:26:06 2022] GET /identity/v3/endpoints?service_id=00f289a358144410b4839e756e9be381&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:06.854971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:06.964433 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9450f2-f15b-4751-9959-3c39922bacf5 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:07.000702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4d822-c293-4b33-b8b4-54cce59f6ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:07.001443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d822-c293-4b33-b8b4-54cce59f6ace None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.001814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d822-c293-4b33-b8b4-54cce59f6ace None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.002099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d822-c293-4b33-b8b4-54cce59f6ace None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.002831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4d822-c293-4b33-b8b4-54cce59f6ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:07.004211 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4d822-c293-4b33-b8b4-54cce59f6ace None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:07.010497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 464/925] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:26:06 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:26:07.097615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c80a-6f8c-4c5c-8cde-4167dcc151af None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.098173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c80a-6f8c-4c5c-8cde-4167dcc151af None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.098173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2c80a-6f8c-4c5c-8cde-4167dcc151af None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.099872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 462/926] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:07.107288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901939-980f-46ea-9e9d-b901a843cce8 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.107723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901939-980f-46ea-9e9d-b901a843cce8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.108127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901939-980f-46ea-9e9d-b901a843cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.126610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-39901939-980f-46ea-9e9d-b901a843cce8 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:07.127816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-39901939-980f-46ea-9e9d-b901a843cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:07.202314 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 465/927] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:07.226685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c80a-6f8c-4c5c-8cde-4167dcc151af None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:07.327372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2c80a-6f8c-4c5c-8cde-4167dcc151af None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:07.362151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcce7b-745e-452a-bd3b-860d4ace4bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:07.363321 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcce7b-745e-452a-bd3b-860d4ace4bfc None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.363826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcce7b-745e-452a-bd3b-860d4ace4bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.364334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcce7b-745e-452a-bd3b-860d4ace4bfc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.375021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcce7b-745e-452a-bd3b-860d4ace4bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-86dcce7b-745e-452a-bd3b-860d4ace4bfc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:07.383627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:07.384554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:07.385407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:07.388320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 463/928] 10.222.0.36 () {56 vars in 1120 bytes} [Wed May 11 07:26:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:07.394390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39901939-980f-46ea-9e9d-b901a843cce8 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:07.493590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39901939-980f-46ea-9e9d-b901a843cce8 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:07.527695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:07.528362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.528646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.528921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.529694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:07.529998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:07.531895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:07.540330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 466/929] 10.222.0.36 () {56 vars in 1115 bytes} [Wed May 11 07:26:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:07.546243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcce7b-745e-452a-bd3b-860d4ace4bfc None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:07.648913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcce7b-745e-452a-bd3b-860d4ace4bfc None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:07.684827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061670e9-5337-4b5b-a4ce-db9a382490ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:07.685684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061670e9-5337-4b5b-a4ce-db9a382490ef None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.685970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061670e9-5337-4b5b-a4ce-db9a382490ef None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.686246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061670e9-5337-4b5b-a4ce-db9a382490ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.698763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061670e9-5337-4b5b-a4ce-db9a382490ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:07.700250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061670e9-5337-4b5b-a4ce-db9a382490ef None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-061670e9-5337-4b5b-a4ce-db9a382490ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:07.718790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:07.720245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:07.721131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:07.721131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:07.721131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:07.721131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:07.721131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 464/930] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:07.727624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:07.832359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897fa61-f1b1-4c38-9f34-bf089809e15a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:07.865747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c497d8b-1d38-458a-ba4c-9bd07388ac56 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.866069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c497d8b-1d38-458a-ba4c-9bd07388ac56 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.866300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c497d8b-1d38-458a-ba4c-9bd07388ac56 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.866408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:07.866978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.867263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.867537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.867916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 465/931] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:07.868265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:07.868570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:07.869964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:07.872971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2321-4402-4795-a8c6-d00fb798c507 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:07.873257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2321-4402-4795-a8c6-d00fb798c507 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:07.873554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c2321-4402-4795-a8c6-d00fb798c507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:07.882576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 467/932] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:07.887870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:07.895172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ea1c2321-4402-4795-a8c6-d00fb798c507 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:07.896025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ea1c2321-4402-4795-a8c6-d00fb798c507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:07.968095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 466/933] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:07.986378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2321-4402-4795-a8c6-d00fb798c507 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.015615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1d332-7687-40a7-948f-dc5edab85449 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.050564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.051427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.051709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.051979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.059291 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.060742 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:26:08.076648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:08.077637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:26:08.079160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:08.083270 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 468/934] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:26:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:08.084205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.104786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c2321-4402-4795-a8c6-d00fb798c507 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.139569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a277d-9036-470e-a2cf-feece098523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.141284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a277d-9036-470e-a2cf-feece098523c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.141867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a277d-9036-470e-a2cf-feece098523c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.142362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a277d-9036-470e-a2cf-feece098523c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.143228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a277d-9036-470e-a2cf-feece098523c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.144803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a277d-9036-470e-a2cf-feece098523c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-bd5a277d-9036-470e-a2cf-feece098523c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:08.158616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:08.159597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 07:26:08.160527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.162770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 467/935] 10.222.0.36 () {56 vars in 1132 bytes} [Wed May 11 07:26:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:08.164209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f13d1-1082-42ab-8791-5bc3934a0fc0 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.164501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f13d1-1082-42ab-8791-5bc3934a0fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.164780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f13d1-1082-42ab-8791-5bc3934a0fc0 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.166188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 468/936] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:08.169405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f13d1-1082-42ab-8791-5bc3934a0fc0 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.188410 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170ec2-0d97-483d-aaf8-0cda21e81259 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.223499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b6333-d17f-4d4b-a940-269e6357b2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.224175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6333-d17f-4d4b-a940-269e6357b2ea None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.224876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6333-d17f-4d4b-a940-269e6357b2ea None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.225157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6333-d17f-4d4b-a940-269e6357b2ea None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.226308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b6333-d17f-4d4b-a940-269e6357b2ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:08.226621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b6333-d17f-4d4b-a940-269e6357b2ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.228827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b6333-d17f-4d4b-a940-269e6357b2ea None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.248721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 469/937] 10.222.0.36 () {56 vars in 1149 bytes} [Wed May 11 07:26:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:08.250590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c20b-8507-4748-8549-2ec1b7297b97 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.250883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c20b-8507-4748-8549-2ec1b7297b97 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.251162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c20b-8507-4748-8549-2ec1b7297b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.269313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f233c20b-8507-4748-8549-2ec1b7297b97 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:08.270531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f233c20b-8507-4748-8549-2ec1b7297b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:08.274186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f13d1-1082-42ab-8791-5bc3934a0fc0 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.307161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.308147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.308615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.309082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.309870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:08.310182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.311553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.317313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 469/938] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:08.318146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.341949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 470/939] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:08.343244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233c20b-8507-4748-8549-2ec1b7297b97 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.424026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de0ba8-4c14-4153-b861-281dc3f596e6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.448180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233c20b-8507-4748-8549-2ec1b7297b97 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.456436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.457290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.461848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.461848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.468884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.470522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.485217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.485770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.486057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.486333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.487038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:08.487347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.488711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:08.492007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:08.492839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:08.503815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:08.503815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:08.503815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:08.503815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.503815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 470/941] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:08.504127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 471/941] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:08.504214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.504284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.590426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad1f39-81bc-41a8-affd-b510fb042b0c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.599818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaf679-a8e7-4c68-af38-921db97ac5b5 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.622657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.623314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.623595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.623865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.624553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.626551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.627902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING keystone.server.flask.common [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 07:26:08.633688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebb1b-b224-483b-926b-1b8a6eb8db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.634508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebb1b-b224-483b-926b-1b8a6eb8db7c None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.634958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebb1b-b224-483b-926b-1b8a6eb8db7c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.635407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ebb1b-b224-483b-926b-1b8a6eb8db7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.636144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebb1b-b224-483b-926b-1b8a6eb8db7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.637496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ebb1b-b224-483b-926b-1b8a6eb8db7c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.646416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.sql.core [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 07:26:08.646416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 07:26:08.646416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [parameters: {'id': '2f61af5ed3f345a1a61b62b0068e1883', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 07:26:08.646416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79913) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 07:26:08.659451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 472/942] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:26:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:08.660532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebb1b-b224-483b-926b-1b8a6eb8db7c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f61af5ed3f345a1a61b62b0068e1883.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f61af5ed3f345a1a61b62b0068e1883. May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result = self._query(query) May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application conn.query(q) May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 07:26:08.664090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result.read() May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 11 07:26:08.664946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return project_ref.to_dict() May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application next(self.gen) May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application yield resource May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application next(self.gen) May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.session.rollback() May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.force_reraise() May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise self.value May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application session.commit() May 11 07:26:08.665933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._prepare_impl() May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.session.flush() May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._flush(objects) May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application compat.raise_( May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application flush_context.execute() May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 07:26:08.666840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rec.execute(self) May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 07:26:08.667762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result = self._query(query) May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application conn.query(q) May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result.read() May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 07:26:08.668555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [parameters: {'id': '2f61af5ed3f345a1a61b62b0068e1883', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.669405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:08.670396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.Conflict( May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f61af5ed3f345a1a61b62b0068e1883. May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.671458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 471/943] 10.222.0.36 () {60 vars in 1140 bytes} [Wed May 11 07:26:08 2022] POST /identity/v3/projects => generated 262 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:08.672710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.788631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d793a8-dcbb-4f0d-80a2-b8e7b0b9069d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.790992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ebb1b-b224-483b-926b-1b8a6eb8db7c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.825905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.826978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.827346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.827720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.829092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:08.829974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:08.830470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:08.830942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:08.831904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:08.832424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.834080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.835919 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:08.837589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:08.849170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 473/944] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:26:08.853857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:08.854717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:08.855609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:26:08.855609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:26:08.855609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:26:08.855609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:26:08.855609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:26:08.855609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:26:08.855609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:08.855609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:08.857408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.860445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 472/945] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:08.861360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:08.976947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda1d2-64ef-4fef-8ca7-9b2ae871c733 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:08.981058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fc5c4-dea2-4bb5-a0ea-d23828f73bc6 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:09.011853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:09.013322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.013800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.014250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.015178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:09.015669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:09.017089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:09.017452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:09.018061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.018340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.018609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.025655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:09.027095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:09.042899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 473/946] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:26:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:26:09.049414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:09.050413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:09.051303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:26:09.051303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:26:09.051303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:26:09.051303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:26:09.051303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:26:09.051303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:26:09.051303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:09.051303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:09.053849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 474/947] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:09.063101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:09.176589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb5085-be5c-4326-ba2a-7470036a9cf4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:09.214875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addeb26-ff9c-420f-90bf-290736f87f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:09.215851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addeb26-ff9c-420f-90bf-290736f87f50 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.216303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addeb26-ff9c-420f-90bf-290736f87f50 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.216725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addeb26-ff9c-420f-90bf-290736f87f50 None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.217717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addeb26-ff9c-420f-90bf-290736f87f50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:09.218196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addeb26-ff9c-420f-90bf-290736f87f50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:09.220410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addeb26-ff9c-420f-90bf-290736f87f50 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:09.233502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 474/948] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:09.242627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:09.318304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57de40-2187-4bce-b388-4eb15dec2409 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.318592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57de40-2187-4bce-b388-4eb15dec2409 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.318872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57de40-2187-4bce-b388-4eb15dec2409 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.320481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 475/949] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:09.325903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b35b70-b571-4f3b-9898-d765fbf09e2d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.326190 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b35b70-b571-4f3b-9898-d765fbf09e2d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.326465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b35b70-b571-4f3b-9898-d765fbf09e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.345525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c3b35b70-b571-4f3b-9898-d765fbf09e2d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:09.347041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c3b35b70-b571-4f3b-9898-d765fbf09e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:09.351512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29ae44-fd7a-4685-8c6b-7949148430ce None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:09.384937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc4fa5-5a43-47f3-ab00-2379241e1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:09.385907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc4fa5-5a43-47f3-ab00-2379241e1312 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.386184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc4fa5-5a43-47f3-ab00-2379241e1312 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.386455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc4fa5-5a43-47f3-ab00-2379241e1312 None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/044d9c04530347b9a03e9c4c352063bf/roles/84b7ff3b93fb4ea697f86076cfbb0034` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.388709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc4fa5-5a43-47f3-ab00-2379241e1312 None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=044d9c04530347b9a03e9c4c352063bf, role_id=84b7ff3b93fb4ea697f86076cfbb0034)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:09.390199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc4fa5-5a43-47f3-ab00-2379241e1312 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:09.407940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 475/950] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:26:09 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/044d9c04530347b9a03e9c4c352063bf/roles/84b7ff3b93fb4ea697f86076cfbb0034 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:26:09.437178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 476/951] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:09.469436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc4fa5-5a43-47f3-ab00-2379241e1312 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:09.583888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc4fa5-5a43-47f3-ab00-2379241e1312 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:09.618452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:09.619648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.619927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.620196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.620840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:09.622280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:09.634826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:09.635862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:09.637159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 476/952] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:09.642902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b35b70-b571-4f3b-9898-d765fbf09e2d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:09.742162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b35b70-b571-4f3b-9898-d765fbf09e2d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:09.776783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:09.777810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.778370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.778842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.779743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:09.780261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:09.781953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:09.791609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 477/953] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:09.793161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:09.894917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f77159-1f6e-412f-81c8-cfde1545e650 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:09.929290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a170a8-4bcc-42df-9dbc-64e32d16d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:09.930318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a170a8-4bcc-42df-9dbc-64e32d16d193 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:09.930824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a170a8-4bcc-42df-9dbc-64e32d16d193 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:09.931308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a170a8-4bcc-42df-9dbc-64e32d16d193 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:09.932202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a170a8-4bcc-42df-9dbc-64e32d16d193 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:09.932724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a170a8-4bcc-42df-9dbc-64e32d16d193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:09.934312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a170a8-4bcc-42df-9dbc-64e32d16d193 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:09.945142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 477/954] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:09.946825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:10.054715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51dacc-2b72-4b8d-baca-619ed7747b81 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:10.089848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d8b00-4825-4dbd-ad1a-da2457c61134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:10.090872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8b00-4825-4dbd-ad1a-da2457c61134 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:10.091369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8b00-4825-4dbd-ad1a-da2457c61134 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:10.091904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d8b00-4825-4dbd-ad1a-da2457c61134 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:10.092887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d8b00-4825-4dbd-ad1a-da2457c61134 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:10.094542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d8b00-4825-4dbd-ad1a-da2457c61134 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:10.115407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 478/955] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:26:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:11.006267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add75b2-b2bf-4875-bd78-e706b4b206e0 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.006789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add75b2-b2bf-4875-bd78-e706b4b206e0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.006789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add75b2-b2bf-4875-bd78-e706b4b206e0 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.008393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 478/956] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:11.013879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafb58a-05f5-4a4d-852e-6b1968c968fe None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.014295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafb58a-05f5-4a4d-852e-6b1968c968fe None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.014478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafb58a-05f5-4a4d-852e-6b1968c968fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.030998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-cdafb58a-05f5-4a4d-852e-6b1968c968fe None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:11.032700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-cdafb58a-05f5-4a4d-852e-6b1968c968fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:11.104919 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 479/957] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:11.127113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add75b2-b2bf-4875-bd78-e706b4b206e0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:11.228031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add75b2-b2bf-4875-bd78-e706b4b206e0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:11.270672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:11.271392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.271678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.271955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] PATH_INFO: `/v3/services/compute` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.272612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:11.274017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:11.286858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:11.287895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:11.288736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:11.290472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 479/958] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:11.294613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafb58a-05f5-4a4d-852e-6b1968c968fe None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:11.402942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafb58a-05f5-4a4d-852e-6b1968c968fe None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:11.443185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64b499-8d05-4581-a0e2-92d83863e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:11.443869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b499-8d05-4581-a0e2-92d83863e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.444156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b499-8d05-4581-a0e2-92d83863e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.444435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b499-8d05-4581-a0e2-92d83863e9c1 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.445152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64b499-8d05-4581-a0e2-92d83863e9c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:11.445461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64b499-8d05-4581-a0e2-92d83863e9c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:11.446858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64b499-8d05-4581-a0e2-92d83863e9c1 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:11.457029 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 480/959] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:26:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:11.462319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:11.475662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5479bcf-1153-47e5-891b-607aa0d1c628 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.475662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5479bcf-1153-47e5-891b-607aa0d1c628 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.475662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5479bcf-1153-47e5-891b-607aa0d1c628 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.478662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 481/960] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:11.490124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2cfec-9e5c-4c37-b408-047e7c5f713d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.490124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2cfec-9e5c-4c37-b408-047e7c5f713d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.490124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2cfec-9e5c-4c37-b408-047e7c5f713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.513330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-fcc2cfec-9e5c-4c37-b408-047e7c5f713d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:11.514554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-fcc2cfec-9e5c-4c37-b408-047e7c5f713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:11.581771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 482/961] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:11.609315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2cfec-9e5c-4c37-b408-047e7c5f713d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:11.666908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4c926-8e7d-45b1-8f30-822fafe7049a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:11.729565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2cfec-9e5c-4c37-b408-047e7c5f713d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:11.742536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769ac5-9a6c-4e82-a153-1f7679a96474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:11.743529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769ac5-9a6c-4e82-a153-1f7679a96474 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.744075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769ac5-9a6c-4e82-a153-1f7679a96474 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.749567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769ac5-9a6c-4e82-a153-1f7679a96474 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.749567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769ac5-9a6c-4e82-a153-1f7679a96474 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:11.749567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769ac5-9a6c-4e82-a153-1f7679a96474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:11.749567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769ac5-9a6c-4e82-a153-1f7679a96474 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:11.766065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 480/962] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:26:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:11.793663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:11.796634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee9ae7-96be-4686-8e94-8420b70ef4ba None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.796634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee9ae7-96be-4686-8e94-8420b70ef4ba None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.796634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee9ae7-96be-4686-8e94-8420b70ef4ba None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.796634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 481/963] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:11.797359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.797625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.800247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.800247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:11.800247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:11.805567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a8bc0-ab98-48c6-b34e-1db6e6565c36 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:11.805567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a8bc0-ab98-48c6-b34e-1db6e6565c36 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:11.805567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a8bc0-ab98-48c6-b34e-1db6e6565c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:11.837625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-127a8bc0-ab98-48c6-b34e-1db6e6565c36 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:11.837625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-127a8bc0-ab98-48c6-b34e-1db6e6565c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:11.840600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.sql.core [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 07:26:11.840600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 07:26:11.840600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [parameters: {'user_id': '41a402b9216b4bc1a8c9921499bd7daa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 07:26:11.840600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79913) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result = self._query(query) May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application conn.query(q) May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result.read() May 11 07:26:11.853148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 07:26:11.854695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application next(self.gen) May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application yield resource May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application next(self.gen) May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.session.rollback() May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.force_reraise() May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise self.value May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application session.commit() May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 07:26:11.855897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._prepare_impl() May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.session.flush() May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._flush(objects) May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application compat.raise_( May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application flush_context.execute() May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rec.execute(self) May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 07:26:11.856952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result = connection._execute_20( May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 07:26:11.865858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result = self._query(query) May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application conn.query(q) May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application result.read() May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 07:26:11.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [parameters: {'user_id': '41a402b9216b4bc1a8c9921499bd7daa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:11.867583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 11 07:26:11.868419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 11 07:26:11.869308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 11 07:26:11.869308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 11 07:26:11.869308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 07:26:11.869308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 07:26:11.869308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 07:26:11.869308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:11.869308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 483/964] 10.222.0.36 () {60 vars in 1131 bytes} [Wed May 11 07:26:11 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:11.869308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:11.961593 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 482/965] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:11.985136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a8bc0-ab98-48c6-b34e-1db6e6565c36 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.006675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9104426-3847-44a5-a385-d738355b9d8b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.040512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.041309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.041625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.041905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.049940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.051656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:26:12.066725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:12.068996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:12.071243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 484/966] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:26:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:12.077577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.088657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a8bc0-ab98-48c6-b34e-1db6e6565c36 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.123276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706950d-788c-4c9c-b85f-3cf2f17e6f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.124091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706950d-788c-4c9c-b85f-3cf2f17e6f16 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.124369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706950d-788c-4c9c-b85f-3cf2f17e6f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.124700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706950d-788c-4c9c-b85f-3cf2f17e6f16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.135824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706950d-788c-4c9c-b85f-3cf2f17e6f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-4706950d-788c-4c9c-b85f-3cf2f17e6f16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:12.144240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:12.146506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:12.148500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:12.158024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 483/967] 10.222.0.36 () {56 vars in 1120 bytes} [Wed May 11 07:26:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:12.158024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706950d-788c-4c9c-b85f-3cf2f17e6f16 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.197488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1de1c-fc08-4ae3-9b28-ad7f0bfba718 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.239856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.240524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.240802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.241073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.241908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:12.242212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.243770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.253406 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706950d-788c-4c9c-b85f-3cf2f17e6f16 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.287892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 485/968] 10.222.0.36 () {56 vars in 1101 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:12.293666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a92dc-4b69-4af3-be0c-64976835a81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.293666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a92dc-4b69-4af3-be0c-64976835a81b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.294097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a92dc-4b69-4af3-be0c-64976835a81b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.294180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a92dc-4b69-4af3-be0c-64976835a81b None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.297923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a92dc-4b69-4af3-be0c-64976835a81b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:12.297923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a92dc-4b69-4af3-be0c-64976835a81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.297923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a92dc-4b69-4af3-be0c-64976835a81b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.308551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 484/969] 10.222.0.36 () {56 vars in 1115 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:12.315052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.430204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbf5be-a6d3-45de-87b6-c74cb0542163 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.467395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.469111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.469642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.470118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.481093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.482890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.485802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9460-49de-462f-8f4a-9d8c49b82384 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.486098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9460-49de-462f-8f4a-9d8c49b82384 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.486600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9460-49de-462f-8f4a-9d8c49b82384 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.487882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 485/970] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:12.493006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989897b-861d-41c4-b032-caf83e4e90c4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.493293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989897b-861d-41c4-b032-caf83e4e90c4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.493608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989897b-861d-41c4-b032-caf83e4e90c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:12.504550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:12.505566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:12.506522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:12.506522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:12.506522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:12.506522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:12.506522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 486/971] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:12.512576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.514403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-4989897b-861d-41c4-b032-caf83e4e90c4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:12.515623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4989897b-861d-41c4-b032-caf83e4e90c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:12.602377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 486/972] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:12.618013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee41c43-c3fc-421e-9e81-075d70c8476e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.625059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989897b-861d-41c4-b032-caf83e4e90c4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.652843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.653502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.653822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.654102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.654819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:12.655124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.657021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.669568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 487/973] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:12.674391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.728227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989897b-861d-41c4-b032-caf83e4e90c4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.763061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.763856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.764145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.764411 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.765047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.766464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.768757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d747c-e163-45b5-bb4c-ca7d1c079a64 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:12.783391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:12.784465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:12.785388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 487/974] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:12.790420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.804280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.805084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.805361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.805661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.813163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.814612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:26:12.829116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:12.830249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 07:26:12.831218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:12.833693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 488/975] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:12.835817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.888186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a399a2-11db-4da1-9525-d281d4d00cc9 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.922379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.923563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.924206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.924585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.925559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:12.926271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.928171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.934056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f7e82-9e87-4ecd-b6bc-1e80c4f610d5 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:12.938653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 488/976] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:12.939484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:12.969333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:12.970027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:12.970305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:12.970580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:12.971405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:12.971709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:12.973155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:12.991060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 489/977] 10.222.0.36 () {56 vars in 1149 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:12.996576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:13.038745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f2b8d-c7cd-45f3-8fea-0baee9257ebc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:13.071162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:13.071825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:13.072167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:13.072451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:13.073154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:13.073466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:13.074874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:13.080421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 489/978] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:13.085801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:13.097021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d4f5-3c41-4f2d-bbdf-7afbeda91908 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:13.130742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993d328-5275-4581-85bf-5eabeb319f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:13.131390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d328-5275-4581-85bf-5eabeb319f8e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:13.131675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d328-5275-4581-85bf-5eabeb319f8e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:13.131950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d328-5275-4581-85bf-5eabeb319f8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:13.180089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e589f-0656-4183-a511-71433aec5cbe None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:13.198862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993d328-5275-4581-85bf-5eabeb319f8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:13.200377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993d328-5275-4581-85bf-5eabeb319f8e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:13.211964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:13.212605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:13.212887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:13.213152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:13.213961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] RBAC: Adding query filter params (interface=admin, service_id=00f289a358144410b4839e756e9be381, region_id=RegionOne) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:13.214271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:13.215618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:13.221080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 490/979] 10.222.0.36 () {56 vars in 1249 bytes} [Wed May 11 07:26:13 2022] GET /identity/v3/endpoints?service_id=00f289a358144410b4839e756e9be381&interface=admin®ion_id=RegionOne => generated 193 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:13.226370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:13.299153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 490/980] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:12 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 07:26:13.304801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993d328-5275-4581-85bf-5eabeb319f8e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:13.322791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058627d-55f1-469c-8628-a2529194ed91 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:13.357258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df1acc-468e-42fa-806e-6f5ac54c3b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:13.358474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df1acc-468e-42fa-806e-6f5ac54c3b1c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:13.359103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df1acc-468e-42fa-806e-6f5ac54c3b1c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:13.359930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df1acc-468e-42fa-806e-6f5ac54c3b1c None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:13.361084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df1acc-468e-42fa-806e-6f5ac54c3b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:13.363535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df1acc-468e-42fa-806e-6f5ac54c3b1c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:13.371528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 491/981] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:26:13 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:26:13.403862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993d328-5275-4581-85bf-5eabeb319f8e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:13.440135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:13.440951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:13.441228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:13.441500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:13.456500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:13.458029 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:13.476860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:13.478186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:13.479067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:13.479067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:13.479067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:13.479067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:13.479733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 491/982] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:13.485410 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df1acc-468e-42fa-806e-6f5ac54c3b1c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:13.588161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df1acc-468e-42fa-806e-6f5ac54c3b1c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:13.620141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:13.620806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:13.621087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:13.621363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:13.622114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:13.622423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:13.623787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:13.640650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 492/983] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:13.641636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:13.736068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b546338-c2a6-457b-a20a-d25779d6396c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:13.768254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:13.769110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:13.769395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:13.769697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:13.776362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:13.777831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:26:13.791247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:13.792129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:13.793020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 492/984] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:13.800296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:13.900512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887449db-5d1b-4949-be21-7509d79ff868 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:13.933302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624b868-c56f-4075-b643-bb826dc5cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:13.934049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b868-c56f-4075-b643-bb826dc5cd0e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:13.934333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b868-c56f-4075-b643-bb826dc5cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:13.934663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b868-c56f-4075-b643-bb826dc5cd0e None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:13.935445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624b868-c56f-4075-b643-bb826dc5cd0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:13.935757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624b868-c56f-4075-b643-bb826dc5cd0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:13.937253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624b868-c56f-4075-b643-bb826dc5cd0e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:13.954162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 493/985] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:13.955213 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:14.051253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af719e5-83a3-4791-86df-9001f64d80c9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:14.058056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af353-f626-4a44-a6bd-37380760facc None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:14.058348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af353-f626-4a44-a6bd-37380760facc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:14.058628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af353-f626-4a44-a6bd-37380760facc None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:14.059988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 494/986] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:14.065285 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e81f2-844f-4786-99b8-3b44474992e9 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:14.065605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e81f2-844f-4786-99b8-3b44474992e9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:14.065896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e81f2-844f-4786-99b8-3b44474992e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:14.084781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:14.085292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6b5e81f2-844f-4786-99b8-3b44474992e9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:14.085439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:14.085758 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:14.086040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:14.086865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] RBAC: Adding query filter params (role.id=84b7ff3b93fb4ea697f86076cfbb0034, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=044d9c04530347b9a03e9c4c352063bf) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:14.087184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:14.087422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6b5e81f2-844f-4786-99b8-3b44474992e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:14.088609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:14.094874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 493/987] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:13 2022] GET /identity/v3/role_assignments?user.id=044d9c04530347b9a03e9c4c352063bf&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=84b7ff3b93fb4ea697f86076cfbb0034 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:14.170028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 495/988] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:14.191967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:14.294652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76426244-e24f-4fdc-9573-7cff7fd5fdb0 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:14.330971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd64958-9d7f-46d6-a923-f7ab85a0aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:14.331630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64958-9d7f-46d6-a923-f7ab85a0aa0d None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:14.331917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64958-9d7f-46d6-a923-f7ab85a0aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:14.332193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd64958-9d7f-46d6-a923-f7ab85a0aa0d None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:14.332926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd64958-9d7f-46d6-a923-f7ab85a0aa0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:14.334324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd64958-9d7f-46d6-a923-f7ab85a0aa0d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:14.349820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 494/989] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:26:14 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:26:15.677759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21649f9-be0c-4255-a7df-acbbc0e9757a None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:15.678290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21649f9-be0c-4255-a7df-acbbc0e9757a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:15.678290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21649f9-be0c-4255-a7df-acbbc0e9757a None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:15.679672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 496/990] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:15.685149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d533-f3aa-4c29-bbc0-4133ab787560 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:15.685588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d533-f3aa-4c29-bbc0-4133ab787560 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:15.685734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d533-f3aa-4c29-bbc0-4133ab787560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:15.702548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f588d533-f3aa-4c29-bbc0-4133ab787560 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:15.704312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f588d533-f3aa-4c29-bbc0-4133ab787560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:15.773660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 495/991] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:15.797392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21649f9-be0c-4255-a7df-acbbc0e9757a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:15.893123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21649f9-be0c-4255-a7df-acbbc0e9757a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:15.925403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:15.926229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:15.926515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:15.926789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:15.927435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:15.928810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:15.940826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:15.941923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 07:26:15.942860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:15.944470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 497/992] 10.222.0.36 () {56 vars in 1126 bytes} [Wed May 11 07:26:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:15.949920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588d533-f3aa-4c29-bbc0-4133ab787560 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:16.049050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588d533-f3aa-4c29-bbc0-4133ab787560 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:16.084757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:16.085855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.086371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.086853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.087770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:16.088293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:16.089907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:16.095901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 496/993] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:16.101186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:16.200246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400cd02-bfae-477e-9e7a-52d36b7ed568 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:16.233322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1241a4a-62b1-4d51-9506-32c81918ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:16.234011 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241a4a-62b1-4d51-9506-32c81918ffef None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.234330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241a4a-62b1-4d51-9506-32c81918ffef None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.234605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1241a4a-62b1-4d51-9506-32c81918ffef None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.235306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1241a4a-62b1-4d51-9506-32c81918ffef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:16.235613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1241a4a-62b1-4d51-9506-32c81918ffef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:16.236969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1241a4a-62b1-4d51-9506-32c81918ffef None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:16.245757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 498/994] 10.222.0.36 () {56 vars in 1122 bytes} [Wed May 11 07:26:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:16.248462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:16.350288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405117c-8f22-4e07-a43a-82f41e8edbfc None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:16.360568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd28c7-c29a-41da-bbe1-4b45e9e63c50 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.360835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd28c7-c29a-41da-bbe1-4b45e9e63c50 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.361103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd28c7-c29a-41da-bbe1-4b45e9e63c50 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.362485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 499/995] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:16.367678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2866dc-0ed5-41a2-8398-485ef85eb6c2 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.367972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2866dc-0ed5-41a2-8398-485ef85eb6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.368252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2866dc-0ed5-41a2-8398-485ef85eb6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.386658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3271f-1094-4890-a5e2-4af42b681298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:16.387325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6e2866dc-0ed5-41a2-8398-485ef85eb6c2 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:16.387437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3271f-1094-4890-a5e2-4af42b681298 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.387604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3271f-1094-4890-a5e2-4af42b681298 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.387873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3271f-1094-4890-a5e2-4af42b681298 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.388551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6e2866dc-0ed5-41a2-8398-485ef85eb6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:16.388658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3271f-1094-4890-a5e2-4af42b681298 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:16.391204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3271f-1094-4890-a5e2-4af42b681298 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:16.406506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 497/996] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:26:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:16.476161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 500/997] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:16.498377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3271f-1094-4890-a5e2-4af42b681298 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:16.576354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea826b-7888-4ac3-8ed4-d4782334f2f9 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.576643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea826b-7888-4ac3-8ed4-d4782334f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.576920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea826b-7888-4ac3-8ed4-d4782334f2f9 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.578900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 501/998] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:16.584399 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352246a-afdd-494b-a8c6-fbef79c864af None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.584684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352246a-afdd-494b-a8c6-fbef79c864af None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.584962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352246a-afdd-494b-a8c6-fbef79c864af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.602824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-5352246a-afdd-494b-a8c6-fbef79c864af None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:16.603935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5352246a-afdd-494b-a8c6-fbef79c864af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:16.606654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3271f-1094-4890-a5e2-4af42b681298 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:16.642037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:16.642826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.643106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.643379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] PATH_INFO: `/v3/services/image` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.644032 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:16.645386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:16.656883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:16.658123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:16.658959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 498/999] 10.222.0.36 () {56 vars in 1105 bytes} [Wed May 11 07:26:16 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:16.663982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:16.676177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 502/1000] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:16.699071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352246a-afdd-494b-a8c6-fbef79c864af None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:16.761104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130fa60-6bfe-4567-839b-d387b64257ed None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:16.790657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352246a-afdd-494b-a8c6-fbef79c864af None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:16.792483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:16.793144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.793422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.793723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.794449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] RBAC: Adding query filter params (name=image) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:16.794728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:16.796084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:16.801462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 499/1001] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:16.806846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:16.824482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:16.825531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.825848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.826121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.826768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:16.828136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:16.839669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:16.840673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:16.841495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 503/1002] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:16.846705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:16.905665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98caca-7e96-4b65-8534-989438b81279 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:16.939145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:16.939815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.940099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.940378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.941081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] RBAC: Adding query filter params (type=image) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:16.941393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:16.942897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:16.947268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 500/1003] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:16.947650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf497cb-ca74-4639-94d0-d2e34f004807 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:16.982620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:16.983296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:16.983576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:16.983847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:16.985118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] RBAC: Adding query filter params (name=compute) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:16.985426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:16.986848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:16.997074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 504/1004] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:26:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:16.997946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:17.100473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49cf87-91ea-43a9-966e-640008d6d694 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:17.136871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:17.137940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:17.137940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:17.138204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:17.139052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] RBAC: Adding query filter params (type=compute) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:17.139169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:17.140532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:17.145576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 501/1005] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:26:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:17.151401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:17.247535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89347134-7946-4ce2-947f-ea856ade6cbc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:17.278873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e432b7-85ef-43ed-a1f9-03613c567e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:17.279534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e432b7-85ef-43ed-a1f9-03613c567e23 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:17.279849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e432b7-85ef-43ed-a1f9-03613c567e23 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:17.280088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e432b7-85ef-43ed-a1f9-03613c567e23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:17.281382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e432b7-85ef-43ed-a1f9-03613c567e23 None admin] RBAC: Adding query filter params (interface=public, service_id=b9889e52288c4cdf8092a1667f1fe5a1, region_id=RegionOne) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:17.281828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e432b7-85ef-43ed-a1f9-03613c567e23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:17.283213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e432b7-85ef-43ed-a1f9-03613c567e23 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:17.288218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 505/1006] 10.222.0.36 () {56 vars in 1251 bytes} [Wed May 11 07:26:17 2022] GET /identity/v3/endpoints?service_id=b9889e52288c4cdf8092a1667f1fe5a1&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:17.293699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:17.390969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f128-5752-4775-b952-25be5836c62a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:17.422475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc686aa-a91f-487f-bf7b-2cd832ade2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:17.423434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc686aa-a91f-487f-bf7b-2cd832ade2a1 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:17.423929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc686aa-a91f-487f-bf7b-2cd832ade2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:17.424413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc686aa-a91f-487f-bf7b-2cd832ade2a1 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:17.425295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc686aa-a91f-487f-bf7b-2cd832ade2a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:17.426860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc686aa-a91f-487f-bf7b-2cd832ade2a1 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:17.433437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 502/1007] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:26:17 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:26:18.662685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c2a6b-5b10-4362-bb4b-fc7296ac5d7c None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:18.663218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c2a6b-5b10-4362-bb4b-fc7296ac5d7c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:18.663218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c2a6b-5b10-4362-bb4b-fc7296ac5d7c None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:18.664613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 506/1008] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:18.669882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b0f0b-16f7-4711-93cd-ebb8882c9333 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:18.670283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b0f0b-16f7-4711-93cd-ebb8882c9333 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:18.670468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b0f0b-16f7-4711-93cd-ebb8882c9333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:18.686678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ab7b0f0b-16f7-4711-93cd-ebb8882c9333 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:18.688604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ab7b0f0b-16f7-4711-93cd-ebb8882c9333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:18.751517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 503/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:18.774759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c2a6b-5b10-4362-bb4b-fc7296ac5d7c None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:18.872177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c2a6b-5b10-4362-bb4b-fc7296ac5d7c None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:18.903900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c127-581f-4c05-8462-3b673b45a6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:18.904688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c127-581f-4c05-8462-3b673b45a6d4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:18.904964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c127-581f-4c05-8462-3b673b45a6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:18.905233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c127-581f-4c05-8462-3b673b45a6d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:18.906425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c127-581f-4c05-8462-3b673b45a6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:18.907849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c127-581f-4c05-8462-3b673b45a6d4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:18.909659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 507/1010] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:18.915061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b0f0b-16f7-4711-93cd-ebb8882c9333 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:19.007615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b0f0b-16f7-4711-93cd-ebb8882c9333 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:19.042265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221d2ce-be6f-48e0-9a26-735de1760bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:19.042945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221d2ce-be6f-48e0-9a26-735de1760bdf None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:19.043228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221d2ce-be6f-48e0-9a26-735de1760bdf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:19.043500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221d2ce-be6f-48e0-9a26-735de1760bdf None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:19.044233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221d2ce-be6f-48e0-9a26-735de1760bdf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:19.045733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221d2ce-be6f-48e0-9a26-735de1760bdf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:19.081583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 504/1011] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:26:18 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:19.219922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaaafb-29bc-4a48-941a-e2a5e7207be8 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:19.220212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaaafb-29bc-4a48-941a-e2a5e7207be8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:19.220495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaaafb-29bc-4a48-941a-e2a5e7207be8 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:19.221915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 508/1012] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:19.227563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f763-b3f0-406d-b25d-77c514234816 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:19.227865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f763-b3f0-406d-b25d-77c514234816 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:19.228153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f763-b3f0-406d-b25d-77c514234816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:19.246079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-78c4f763-b3f0-406d-b25d-77c514234816 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:19.247290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-78c4f763-b3f0-406d-b25d-77c514234816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:19.316562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 505/1013] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:19.338337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaaafb-29bc-4a48-941a-e2a5e7207be8 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:19.436992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaaafb-29bc-4a48-941a-e2a5e7207be8 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:19.470052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e453c4-b98a-45e1-9c7c-a7b11fcffbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:19.470737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e453c4-b98a-45e1-9c7c-a7b11fcffbbb None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:19.471013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e453c4-b98a-45e1-9c7c-a7b11fcffbbb None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:19.471279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e453c4-b98a-45e1-9c7c-a7b11fcffbbb None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:19.472022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e453c4-b98a-45e1-9c7c-a7b11fcffbbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:19.473448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e453c4-b98a-45e1-9c7c-a7b11fcffbbb None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:19.501587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 509/1014] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:26:19 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:19.668624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dad28-cd97-4cce-a467-93ba166184a9 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:19.668949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dad28-cd97-4cce-a467-93ba166184a9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:19.669184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dad28-cd97-4cce-a467-93ba166184a9 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:19.670745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 506/1015] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:19.675904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10709-c06c-49cc-95f0-434ec621ec20 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:19.676305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10709-c06c-49cc-95f0-434ec621ec20 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:19.676458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10709-c06c-49cc-95f0-434ec621ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:19.693485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8ad10709-c06c-49cc-95f0-434ec621ec20 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:19.694711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8ad10709-c06c-49cc-95f0-434ec621ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:19.765074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 510/1016] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:19 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:19.788686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dad28-cd97-4cce-a467-93ba166184a9 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:19.885893 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dad28-cd97-4cce-a467-93ba166184a9 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:19.918774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:19.919486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:19.919766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:19.920037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:19.920684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:19.922110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:19.933530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:19.934507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 07:26:19.935366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:19.937721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 507/1017] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:19.940961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad10709-c06c-49cc-95f0-434ec621ec20 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:20.034617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad10709-c06c-49cc-95f0-434ec621ec20 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:20.066362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:20.067014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:20.067293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:20.067561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:20.068249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:20.068559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:20.069936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:20.079649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 511/1018] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:26:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:20.080768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:20.176846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc534630-3d1f-4653-b0a9-90da356e9a11 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:20.212739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf71fd-6f78-4521-8017-c2734d04510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:20.213408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf71fd-6f78-4521-8017-c2734d04510e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:20.213736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf71fd-6f78-4521-8017-c2734d04510e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:20.214012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf71fd-6f78-4521-8017-c2734d04510e None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:20.214725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf71fd-6f78-4521-8017-c2734d04510e None admin] RBAC: Adding query filter params (type=compute) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:20.215034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf71fd-6f78-4521-8017-c2734d04510e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:20.216387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf71fd-6f78-4521-8017-c2734d04510e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:20.221245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 508/1019] 10.222.0.36 () {56 vars in 1112 bytes} [Wed May 11 07:26:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:20.226577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:20.322702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444437f4-1487-4786-9f21-9b933cf86c25 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:20.355639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22428a-2113-4ed2-841e-93c8fa3ff704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:20.356305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22428a-2113-4ed2-841e-93c8fa3ff704 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:20.356592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22428a-2113-4ed2-841e-93c8fa3ff704 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:20.356872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22428a-2113-4ed2-841e-93c8fa3ff704 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:20.357660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22428a-2113-4ed2-841e-93c8fa3ff704 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:20.359560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22428a-2113-4ed2-841e-93c8fa3ff704 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:20.385633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 512/1020] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:26:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:21.379883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91eca-78a0-44a3-9812-11533c1d10cb None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:21.380425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91eca-78a0-44a3-9812-11533c1d10cb None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:21.380425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b91eca-78a0-44a3-9812-11533c1d10cb None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:21.382689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 509/1021] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:21.387351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb8be-2ccd-4e2b-91e7-1d9e329f726b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:21.387753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb8be-2ccd-4e2b-91e7-1d9e329f726b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:21.387935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb8be-2ccd-4e2b-91e7-1d9e329f726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:21.404478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-917cb8be-2ccd-4e2b-91e7-1d9e329f726b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:21.405671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-917cb8be-2ccd-4e2b-91e7-1d9e329f726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:21.487765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 513/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:21.523118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b91eca-78a0-44a3-9812-11533c1d10cb None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:21.635069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b91eca-78a0-44a3-9812-11533c1d10cb None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:21.667409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675e7ee-1a6f-4892-a9a0-71ea97f25ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:21.668201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e7ee-1a6f-4892-a9a0-71ea97f25ed1 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:21.668477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e7ee-1a6f-4892-a9a0-71ea97f25ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:21.668744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e7ee-1a6f-4892-a9a0-71ea97f25ed1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:21.669953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675e7ee-1a6f-4892-a9a0-71ea97f25ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:21.671378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675e7ee-1a6f-4892-a9a0-71ea97f25ed1 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:21.677634 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 510/1023] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:21.678849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb8be-2ccd-4e2b-91e7-1d9e329f726b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:21.751049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720a92-516a-4ccb-b006-6ede83a75338 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:21.751381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720a92-516a-4ccb-b006-6ede83a75338 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:21.751610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720a92-516a-4ccb-b006-6ede83a75338 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:21.752985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 511/1024] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:21.758241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed55e7-189d-4e1a-9ae0-37c9f425c0ea None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:21.758590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed55e7-189d-4e1a-9ae0-37c9f425c0ea None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:21.758839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed55e7-189d-4e1a-9ae0-37c9f425c0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:21.776318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-56ed55e7-189d-4e1a-9ae0-37c9f425c0ea None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:21.776710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb8be-2ccd-4e2b-91e7-1d9e329f726b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:21.777479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-56ed55e7-189d-4e1a-9ae0-37c9f425c0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:21.809942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b36a7a-249f-4e64-9c3a-c13194b5c6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:21.810605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36a7a-249f-4e64-9c3a-c13194b5c6bc None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:21.810884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36a7a-249f-4e64-9c3a-c13194b5c6bc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:21.811157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b36a7a-249f-4e64-9c3a-c13194b5c6bc None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:21.811852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b36a7a-249f-4e64-9c3a-c13194b5c6bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:21.814056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b36a7a-249f-4e64-9c3a-c13194b5c6bc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:21.842754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 514/1025] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:26:21 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:21.851613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 512/1026] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:21.877330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b36a7a-249f-4e64-9c3a-c13194b5c6bc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:21.978775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b36a7a-249f-4e64-9c3a-c13194b5c6bc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:22.013054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:22.013891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.014170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.014436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] PATH_INFO: `/v3/services/image` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:22.015125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:22.016499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:22.028529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:22.029607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:22.030565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:22.033713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 515/1027] 10.222.0.36 () {56 vars in 1105 bytes} [Wed May 11 07:26:21 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:22.035848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed55e7-189d-4e1a-9ae0-37c9f425c0ea None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:22.151039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed55e7-189d-4e1a-9ae0-37c9f425c0ea None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:22.183483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:22.184145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.184426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.184694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:22.185395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:22.185735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:22.187163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:22.192633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 513/1028] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:22.198076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:22.296324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3338-b1ea-41fe-a3b1-c757ef845b3e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:22.328370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:22.329028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.329307 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.329601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:22.330299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] RBAC: Adding query filter params (type=image) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:22.330604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:22.331955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:22.336798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 516/1029] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:22.342441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:22.436851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334e43-0f9f-493d-9ac7-73a710e805d2 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:22.470607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3ec91-cb4d-4f5d-9e72-2ddd5d0065f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:22.471270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ec91-cb4d-4f5d-9e72-2ddd5d0065f3 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.471551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ec91-cb4d-4f5d-9e72-2ddd5d0065f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.471824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3ec91-cb4d-4f5d-9e72-2ddd5d0065f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:22.472601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ec91-cb4d-4f5d-9e72-2ddd5d0065f3 None admin] RBAC: Adding query filter params (interface=public, service_id=4e2e5c7daac94078b9533af470f2c1fc, region_id=RegionOne) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:22.472909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ec91-cb4d-4f5d-9e72-2ddd5d0065f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:22.474406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3ec91-cb4d-4f5d-9e72-2ddd5d0065f3 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:22.484496 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 514/1030] 10.222.0.36 () {56 vars in 1251 bytes} [Wed May 11 07:26:22 2022] GET /identity/v3/endpoints?service_id=4e2e5c7daac94078b9533af470f2c1fc&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:22.486323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:22.587625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459bd11-b3c8-4c5c-a9d3-bc960704e15b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:22.620039 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851d4ee-5397-4e9d-860c-ac12a27755e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:22.620700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851d4ee-5397-4e9d-860c-ac12a27755e7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.620978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851d4ee-5397-4e9d-860c-ac12a27755e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.621247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851d4ee-5397-4e9d-860c-ac12a27755e7 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:22.621943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851d4ee-5397-4e9d-860c-ac12a27755e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:22.623296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851d4ee-5397-4e9d-860c-ac12a27755e7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:22.633624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 517/1031] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:26:22 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:26:22.735587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d386bc-8db4-48aa-9c07-6cdca53f5e3f None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.735880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d386bc-8db4-48aa-9c07-6cdca53f5e3f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.736161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d386bc-8db4-48aa-9c07-6cdca53f5e3f None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:22.737788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 515/1032] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:22.743521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ed9c-a4f7-4aa1-9e41-9b657a35f913 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.743820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ed9c-a4f7-4aa1-9e41-9b657a35f913 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.744104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ed9c-a4f7-4aa1-9e41-9b657a35f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:22.762086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1dd0ed9c-a4f7-4aa1-9e41-9b657a35f913 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:22.763313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1dd0ed9c-a4f7-4aa1-9e41-9b657a35f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:22.831611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 518/1033] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:22.855632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d386bc-8db4-48aa-9c07-6cdca53f5e3f None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:22.958300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d386bc-8db4-48aa-9c07-6cdca53f5e3f None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:22.992514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1479ee-2696-4f86-9cdb-a1a77aa1a587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:22.993329 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1479ee-2696-4f86-9cdb-a1a77aa1a587 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:22.993643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1479ee-2696-4f86-9cdb-a1a77aa1a587 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:22.993926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1479ee-2696-4f86-9cdb-a1a77aa1a587 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:23.004126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1479ee-2696-4f86-9cdb-a1a77aa1a587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-af1479ee-2696-4f86-9cdb-a1a77aa1a587 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:23.012354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:23.013301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:23.014519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:23.015501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 516/1034] 10.222.0.36 () {56 vars in 1120 bytes} [Wed May 11 07:26:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:23.020070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ed9c-a4f7-4aa1-9e41-9b657a35f913 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:23.116814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ed9c-a4f7-4aa1-9e41-9b657a35f913 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:23.150759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:23.151724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:23.152209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:23.152666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:23.153633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:23.154154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:23.156208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:23.169356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 519/1035] 10.222.0.36 () {56 vars in 1115 bytes} [Wed May 11 07:26:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:23.170932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1479ee-2696-4f86-9cdb-a1a77aa1a587 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:23.271912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1479ee-2696-4f86-9cdb-a1a77aa1a587 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:23.306085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:23.307128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:23.307669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:23.308125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:23.319323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:23.320995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:23.338592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:23.339490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:23.340422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:23.340422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:23.340422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:23.340422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:23.342087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 517/1036] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:23.348506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:23.443477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971a530-c8e2-463f-9b6f-f8c3a493177a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:23.484037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:23.484783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:23.485066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:23.485336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:23.486090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:23.486399 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:23.487797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:23.500416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 520/1037] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:23.505804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:23.600043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1af3fa-530d-433f-b070-25ed2dbcda3c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:23.630857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:23.631643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:23.631919 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:23.632184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:23.639408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:23.641365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:26:23.655142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:23.656728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:26:23.658334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:23.661735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 518/1038] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:26:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:23.662536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:23.756131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197ba6c-0016-445c-bdad-0b9b76bb2b45 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:23.789754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:23.790419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:23.790699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:23.790972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:23.791794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:23.792099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:23.793640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:23.815893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 521/1039] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:26:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:23.817528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:23.915048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3aaa4-6097-40f2-8551-3b629a5b2822 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:23.946691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d3490-6864-40fd-abab-74bd3a228e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:23.947334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3490-6864-40fd-abab-74bd3a228e5a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:23.947622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3490-6864-40fd-abab-74bd3a228e5a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:23.947898 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3490-6864-40fd-abab-74bd3a228e5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.014644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d3490-6864-40fd-abab-74bd3a228e5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.016657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d3490-6864-40fd-abab-74bd3a228e5a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:24.113590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 519/1040] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:26:24.115275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.165699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376550d-a616-4c9f-a216-0634c19cc2a8 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.166012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376550d-a616-4c9f-a216-0634c19cc2a8 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.166252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376550d-a616-4c9f-a216-0634c19cc2a8 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.167759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 520/1041] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:24.172944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d532-acab-4031-b1e6-aae436d6b099 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.173233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d532-acab-4031-b1e6-aae436d6b099 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.173507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438d532-acab-4031-b1e6-aae436d6b099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.190153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7438d532-acab-4031-b1e6-aae436d6b099 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:24.191305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7438d532-acab-4031-b1e6-aae436d6b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:24.212940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33e39-e3cc-4c56-b695-b98ac71b5ebc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.246320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.247117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.247398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.247669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.257004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 521/1042] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:24.258066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.259512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:24.276612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:24.277501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:24.283216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:24.283216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:24.283216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:24.283216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:24.283216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 522/1043] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:24.283505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d532-acab-4031-b1e6-aae436d6b099 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.284959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.376411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438d532-acab-4031-b1e6-aae436d6b099 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.380135 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e57ac-ac66-4e51-bea5-8429ee8fc67d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.410009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39fea1-0628-4c57-828c-560b895ba232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.410796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39fea1-0628-4c57-828c-560b895ba232 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.411075 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39fea1-0628-4c57-828c-560b895ba232 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.411345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39fea1-0628-4c57-828c-560b895ba232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.413033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.413876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.413998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.414272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.414991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:24.415300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.416672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:24.421211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39fea1-0628-4c57-828c-560b895ba232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:24.432951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 523/1044] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-df39fea1-0628-4c57-828c-560b895ba232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:24.433138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:24.434220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:24.435059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 522/1045] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:24.435752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.436576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39fea1-0628-4c57-828c-560b895ba232 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.536037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39fea1-0628-4c57-828c-560b895ba232 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.541393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37494f17-b543-4886-a1fc-0ef28e1db15e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.569525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.570217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.570504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.570780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.571521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:24.571827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.573193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:24.574076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.574878 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.575152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.575425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.581638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 523/1046] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:24.583748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.585224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:24.587283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:26:24.603043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:24.604024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:24.604988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:26:24.604988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:26:24.604988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:26:24.604988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:26:24.604988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:26:24.604988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:26:24.604988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:24.604988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:24.606166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 524/1047] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:24.611267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.686134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9900d2-7ce6-457a-a7d7-d4cf1b516499 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.709619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1c7f1-cf7f-44a4-8211-89c4c89a4f8a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.727994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b414a66-cad8-46be-a716-7423b4616fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.729309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b414a66-cad8-46be-a716-7423b4616fd5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.729628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b414a66-cad8-46be-a716-7423b4616fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.729908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b414a66-cad8-46be-a716-7423b4616fd5 None admin] PATH_INFO: `/v3/users/4f9cd3c55d1b4638b56dd82c332e9613` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.746748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b414a66-cad8-46be-a716-7423b4616fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=4f9cd3c55d1b4638b56dd82c332e9613)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.747272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.747937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.748200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b414a66-cad8-46be-a716-7423b4616fd5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:24.748315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.748478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.749390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:24.749868 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.751941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:24.753706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 524/1048] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/users/4f9cd3c55d1b4638b56dd82c332e9613 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:24.756252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b414a66-cad8-46be-a716-7423b4616fd5 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.765058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 525/1049] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:24.771169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:24.855413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b414a66-cad8-46be-a716-7423b4616fd5 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.871276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f39536-1d9e-4ed6-87ea-e83d64b37c6f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:24.888304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0630c4-b08d-4b55-ba0e-5b8182c70607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.888955 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0630c4-b08d-4b55-ba0e-5b8182c70607 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.889324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0630c4-b08d-4b55-ba0e-5b8182c70607 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.889683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0630c4-b08d-4b55-ba0e-5b8182c70607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.909313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eec930-d97e-4b36-a5aa-bd318f399bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:24.910014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec930-d97e-4b36-a5aa-bd318f399bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.910302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec930-d97e-4b36-a5aa-bd318f399bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.910577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eec930-d97e-4b36-a5aa-bd318f399bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.911402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eec930-d97e-4b36-a5aa-bd318f399bd9 None admin] RBAC: Adding query filter params (role.id=84b7ff3b93fb4ea697f86076cfbb0034, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=d42155dc7b5f42b79943f99952448202) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:24.911717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eec930-d97e-4b36-a5aa-bd318f399bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.913151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eec930-d97e-4b36-a5aa-bd318f399bd9 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:24.919107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 526/1050] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/role_assignments?user.id=d42155dc7b5f42b79943f99952448202&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=84b7ff3b93fb4ea697f86076cfbb0034 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:24.920485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea96aa-5cfa-45f8-a949-74e5bd25171a None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.920781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea96aa-5cfa-45f8-a949-74e5bd25171a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.921062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea96aa-5cfa-45f8-a949-74e5bd25171a None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.923202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 527/1051] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:24.929257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb0b2-9d42-4a03-8a70-d071527915a0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:24.929618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb0b2-9d42-4a03-8a70-d071527915a0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:24.929865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb0b2-9d42-4a03-8a70-d071527915a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:24.948399 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a2dfb0b2-9d42-4a03-8a70-d071527915a0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:24.949701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a2dfb0b2-9d42-4a03-8a70-d071527915a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:24.962713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0630c4-b08d-4b55-ba0e-5b8182c70607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:24.964197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0630c4-b08d-4b55-ba0e-5b8182c70607 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:25.029121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 528/1052] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:25.052668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfb0b2-9d42-4a03-8a70-d071527915a0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:25.073898 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 525/1053] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 07:26:25.080279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0630c4-b08d-4b55-ba0e-5b8182c70607 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:25.160293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfb0b2-9d42-4a03-8a70-d071527915a0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:25.188469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0630c4-b08d-4b55-ba0e-5b8182c70607 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:25.195125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:25.195914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:25.196198 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:25.196474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] PATH_INFO: `/v3/services/image` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:25.197129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:25.198530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:25.210661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:25.214213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:25.215260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 529/1054] 10.222.0.36 () {56 vars in 1105 bytes} [Wed May 11 07:26:25 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:25.219729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:25.229187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae2c79-4292-44b6-8f94-bb0f19c0fbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:25.230081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2c79-4292-44b6-8f94-bb0f19c0fbd4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:25.230373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2c79-4292-44b6-8f94-bb0f19c0fbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:25.230656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2c79-4292-44b6-8f94-bb0f19c0fbd4 None admin] PATH_INFO: `/v3/projects/e0880194ba40475ebed35dac6f0aff76` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:25.231841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae2c79-4292-44b6-8f94-bb0f19c0fbd4 None admin] RBAC: Authorizing `identity:get_project(project_id=e0880194ba40475ebed35dac6f0aff76)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:25.233300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae2c79-4292-44b6-8f94-bb0f19c0fbd4 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:25.235308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 526/1055] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:25 2022] GET /identity/v3/projects/e0880194ba40475ebed35dac6f0aff76 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:25.241460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae2c79-4292-44b6-8f94-bb0f19c0fbd4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:25.320265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3cef-47e4-4e33-8e4e-c1904a2b6d59 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:25.339936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae2c79-4292-44b6-8f94-bb0f19c0fbd4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:25.356200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:25.356864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:25.357153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:25.357444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:25.358164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] RBAC: Adding query filter params (name=image) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:25.358476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:25.359887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:25.369301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 530/1056] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:25.370753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:25.373559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:25.374219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:25.375016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:25.375292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:25.376122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=e0880194ba40475ebed35dac6f0aff76, user.id=4f9cd3c55d1b4638b56dd82c332e9613) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:25.376436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:25.377890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:25.383525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 527/1057] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:25 2022] GET /identity/v3/role_assignments?user.id=4f9cd3c55d1b4638b56dd82c332e9613&scope.project.id=e0880194ba40475ebed35dac6f0aff76&role.id=de114c58fdc8476ebab657e6f9359155 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:25.476249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4bb41-10c9-4be7-9e08-f38431f9b9c9 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:25.511180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177dd1f-03d7-4075-9d33-8546b33235dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:25.511872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177dd1f-03d7-4075-9d33-8546b33235dd None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:25.512158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177dd1f-03d7-4075-9d33-8546b33235dd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:25.512431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177dd1f-03d7-4075-9d33-8546b33235dd None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:25.513148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177dd1f-03d7-4075-9d33-8546b33235dd None admin] RBAC: Adding query filter params (type=image) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:25.513458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177dd1f-03d7-4075-9d33-8546b33235dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:25.514885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177dd1f-03d7-4075-9d33-8546b33235dd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:25.525660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 531/1058] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:25.526827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:25.632661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758a7f7-ab88-4a98-93a2-16760077a977 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:25.664570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c4f40-4388-4c08-a6b1-b686c37719de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:25.665227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4f40-4388-4c08-a6b1-b686c37719de None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:25.665509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4f40-4388-4c08-a6b1-b686c37719de None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:25.665810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c4f40-4388-4c08-a6b1-b686c37719de None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:25.666539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c4f40-4388-4c08-a6b1-b686c37719de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:25.667885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c4f40-4388-4c08-a6b1-b686c37719de None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:25.697569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 528/1059] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:26:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:26:27.153981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4673d-7235-492c-97e5-1eee3d706c16 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.154536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4673d-7235-492c-97e5-1eee3d706c16 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.154536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4673d-7235-492c-97e5-1eee3d706c16 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.156051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 532/1060] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:27.161095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd6a1-72f9-4ef0-8287-cd48c87032d2 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.161575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd6a1-72f9-4ef0-8287-cd48c87032d2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.161874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd6a1-72f9-4ef0-8287-cd48c87032d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.178623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-16ffd6a1-72f9-4ef0-8287-cd48c87032d2 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:27.179809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-16ffd6a1-72f9-4ef0-8287-cd48c87032d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:27.251564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 529/1061] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:27.274222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4673d-7235-492c-97e5-1eee3d706c16 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:27.371079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4673d-7235-492c-97e5-1eee3d706c16 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:27.403504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1db7-be72-4e89-abff-d442c419dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:27.404667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1db7-be72-4e89-abff-d442c419dce3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.405142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1db7-be72-4e89-abff-d442c419dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.405628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1db7-be72-4e89-abff-d442c419dce3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.415326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf1db7-be72-4e89-abff-d442c419dce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-49bf1db7-be72-4e89-abff-d442c419dce3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:27.424195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:27.425193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:27.426059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:27.429688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 533/1062] 10.222.0.36 () {56 vars in 1120 bytes} [Wed May 11 07:26:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:27.432871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd6a1-72f9-4ef0-8287-cd48c87032d2 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:27.532521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd6a1-72f9-4ef0-8287-cd48c87032d2 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:27.565101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128cac8-6c97-4e58-9a09-cee7f658df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:27.565800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128cac8-6c97-4e58-9a09-cee7f658df20 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.566085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128cac8-6c97-4e58-9a09-cee7f658df20 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.566360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128cac8-6c97-4e58-9a09-cee7f658df20 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.567106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128cac8-6c97-4e58-9a09-cee7f658df20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:27.567415 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128cac8-6c97-4e58-9a09-cee7f658df20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:27.568778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128cac8-6c97-4e58-9a09-cee7f658df20 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:27.576685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 530/1063] 10.222.0.36 () {56 vars in 1115 bytes} [Wed May 11 07:26:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:27.582275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1db7-be72-4e89-abff-d442c419dce3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:27.631539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e846504-4865-4736-9e56-c1037352ae23 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.631847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e846504-4865-4736-9e56-c1037352ae23 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.632108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e846504-4865-4736-9e56-c1037352ae23 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.633571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 531/1064] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:27.638268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de3b6f-2ed9-4bd4-bab9-75122bc2945b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.638554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de3b6f-2ed9-4bd4-bab9-75122bc2945b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.638829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de3b6f-2ed9-4bd4-bab9-75122bc2945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.654995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-68de3b6f-2ed9-4bd4-bab9-75122bc2945b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:27.656623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-68de3b6f-2ed9-4bd4-bab9-75122bc2945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:27.678188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1db7-be72-4e89-abff-d442c419dce3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:27.709705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:27.710719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.711162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.711574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.721712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 532/1065] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:27.723708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:27.725206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:27.744372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:27.745337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:27.746605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:27.746605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:27.746605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:27.746605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:27.746836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de3b6f-2ed9-4bd4-bab9-75122bc2945b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:27.746912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 534/1066] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:27.753025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:27.840856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de3b6f-2ed9-4bd4-bab9-75122bc2945b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:27.848945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe688f9-2347-4bad-8821-52db2e67ac06 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:27.875299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6dd52-3021-4e3b-9182-426268c8214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:27.876105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6dd52-3021-4e3b-9182-426268c8214d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.876518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6dd52-3021-4e3b-9182-426268c8214d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.876696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6dd52-3021-4e3b-9182-426268c8214d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.882985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:27.883648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:27.884020 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:27.884285 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:27.885002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:27.885306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:27.886692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:27.888795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6dd52-3021-4e3b-9182-426268c8214d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-2fd6dd52-3021-4e3b-9182-426268c8214d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:27.897072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:27.898214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:27.904161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 533/1067] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:27.904884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 535/1068] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:27.905413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6dd52-3021-4e3b-9182-426268c8214d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:27.906147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:27.995987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd57227-15cc-4c62-b751-2ba09bbf5728 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:27.997863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6dd52-3021-4e3b-9182-426268c8214d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.027567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a496ea-5c10-47bf-92c9-3fd711a74a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.028346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a496ea-5c10-47bf-92c9-3fd711a74a53 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.028625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a496ea-5c10-47bf-92c9-3fd711a74a53 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.028891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a496ea-5c10-47bf-92c9-3fd711a74a53 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.035446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1145199-0e77-4e02-848c-9519381a9092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.036102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145199-0e77-4e02-848c-9519381a9092 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.036242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a496ea-5c10-47bf-92c9-3fd711a74a53 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.036379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145199-0e77-4e02-848c-9519381a9092 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.036649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145199-0e77-4e02-848c-9519381a9092 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.037382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1145199-0e77-4e02-848c-9519381a9092 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:28.037722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a496ea-5c10-47bf-92c9-3fd711a74a53 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.037819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1145199-0e77-4e02-848c-9519381a9092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.039053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1145199-0e77-4e02-848c-9519381a9092 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.047010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 534/1069] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:28.047010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47335a90-16d1-4b9a-9017-c96bbe4801ac None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.047010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47335a90-16d1-4b9a-9017-c96bbe4801ac None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.047010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47335a90-16d1-4b9a-9017-c96bbe4801ac None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.047010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 535/1070] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-07a496ea-5c10-47bf-92c9-3fd711a74a53 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:26:28.052214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:28.053258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:28.054357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 536/1071] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:26:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:28.055005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47335a90-16d1-4b9a-9017-c96bbe4801ac None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.056542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e26c-9405-427c-a2cf-b7bdd9006f9a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.056837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e26c-9405-427c-a2cf-b7bdd9006f9a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.057169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549e26c-9405-427c-a2cf-b7bdd9006f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.073234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0549e26c-9405-427c-a2cf-b7bdd9006f9a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:28.074482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0549e26c-9405-427c-a2cf-b7bdd9006f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:28.136713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 537/1072] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:28.137346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e26c-9405-427c-a2cf-b7bdd9006f9a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.152391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47335a90-16d1-4b9a-9017-c96bbe4801ac None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.184696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18e25-00c8-4be1-b1bf-2ab0b6871ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.185590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18e25-00c8-4be1-b1bf-2ab0b6871ffd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.185876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18e25-00c8-4be1-b1bf-2ab0b6871ffd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.186149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18e25-00c8-4be1-b1bf-2ab0b6871ffd None admin] PATH_INFO: `/v3/users/4f9cd3c55d1b4638b56dd82c332e9613` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.187346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18e25-00c8-4be1-b1bf-2ab0b6871ffd None admin] RBAC: Authorizing `identity:get_user(user_id=4f9cd3c55d1b4638b56dd82c332e9613)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.189020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18e25-00c8-4be1-b1bf-2ab0b6871ffd None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.193579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 536/1073] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/users/4f9cd3c55d1b4638b56dd82c332e9613 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:28.193579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18e25-00c8-4be1-b1bf-2ab0b6871ffd None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.231410 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549e26c-9405-427c-a2cf-b7bdd9006f9a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.263569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.264225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.264504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.264774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.266187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:28.266494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.267898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.284136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 538/1074] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:28.284930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.290284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18e25-00c8-4be1-b1bf-2ab0b6871ffd None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.322615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dfe2a-9b50-462b-893e-dd9cadd5c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.323260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dfe2a-9b50-462b-893e-dd9cadd5c20c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.323543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dfe2a-9b50-462b-893e-dd9cadd5c20c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.323820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dfe2a-9b50-462b-893e-dd9cadd5c20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.376013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d0a19-04ff-4c8d-bf22-99c4e7ede524 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.386899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dfe2a-9b50-462b-893e-dd9cadd5c20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.388344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dfe2a-9b50-462b-893e-dd9cadd5c20c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.407606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a113b3-0b5c-4962-bf67-b9d312e84b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.408443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a113b3-0b5c-4962-bf67-b9d312e84b05 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.408716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a113b3-0b5c-4962-bf67-b9d312e84b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.408987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a113b3-0b5c-4962-bf67-b9d312e84b05 None admin] PATH_INFO: `/v3/projects/e0880194ba40475ebed35dac6f0aff76` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.410157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a113b3-0b5c-4962-bf67-b9d312e84b05 None admin] RBAC: Authorizing `identity:get_project(project_id=e0880194ba40475ebed35dac6f0aff76)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.411556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a113b3-0b5c-4962-bf67-b9d312e84b05 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.413211 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 539/1075] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/projects/e0880194ba40475ebed35dac6f0aff76 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:28.413984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a113b3-0b5c-4962-bf67-b9d312e84b05 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.481731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 537/1076] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:26:28.481731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dfe2a-9b50-462b-893e-dd9cadd5c20c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.508262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a113b3-0b5c-4962-bf67-b9d312e84b05 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.539955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.540733 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.541014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.541288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.550817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.552253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:28.570348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:28.571477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:28.572363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:28.572363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:28.572363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:28.572363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:28.572363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 540/1077] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:28.572363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.573956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dfe2a-9b50-462b-893e-dd9cadd5c20c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.606013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0adff-020c-46ef-84f7-e2a48c44e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.606889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0adff-020c-46ef-84f7-e2a48c44e9ee None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.607164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0adff-020c-46ef-84f7-e2a48c44e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.607431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0adff-020c-46ef-84f7-e2a48c44e9ee None admin] PATH_INFO: `/v3/projects/e0880194ba40475ebed35dac6f0aff76/users/4f9cd3c55d1b4638b56dd82c332e9613/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.609887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0adff-020c-46ef-84f7-e2a48c44e9ee None admin] RBAC: Authorizing `identity:create_grant(project_id=e0880194ba40475ebed35dac6f0aff76, user_id=4f9cd3c55d1b4638b56dd82c332e9613, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.611313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0adff-020c-46ef-84f7-e2a48c44e9ee None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.623595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 538/1078] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:26:28 2022] PUT /identity/v3/projects/e0880194ba40475ebed35dac6f0aff76/users/4f9cd3c55d1b4638b56dd82c332e9613/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:26:28.625019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0adff-020c-46ef-84f7-e2a48c44e9ee None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.668467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfaf595-f025-40c7-b8a6-8ce686b14c62 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.708636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.709444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.709788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.710014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.721194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.722729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.729609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0adff-020c-46ef-84f7-e2a48c44e9ee None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:28.741699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:28.742734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:28.743615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:28.743615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:28.743615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:28.743615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:28.743615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 541/1079] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:28.749033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.769055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.769766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.770047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.770321 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.771054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:28.771359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.773035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.784592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 539/1080] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:28.790474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:28.854699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e032d8-1715-48f2-9d9a-33a0fd0e078d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.888303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.889190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.889681 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.889996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.890712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:28.891018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.892367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.895148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363e323-f457-458e-85cb-7fe13a6b1386 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:28.903214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 542/1081] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:28.929804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:28.930719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:28.931001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:28.931329 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:28.939764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:28.941227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:26:28.956524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:28.957494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:28.958518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:26:28.958518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:26:28.958518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:26:28.958518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:26:28.958518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:26:28.958518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:26:28.958518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:28.958518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:28.961951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 540/1082] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:28.963743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:29.067574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881af02-c01d-42b1-a07c-6402bc2db79b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:29.107995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece56e75-480c-4e82-bbb0-417dc600e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:29.109232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece56e75-480c-4e82-bbb0-417dc600e4cd None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:29.109527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece56e75-480c-4e82-bbb0-417dc600e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:29.109827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece56e75-480c-4e82-bbb0-417dc600e4cd None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:29.110608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece56e75-480c-4e82-bbb0-417dc600e4cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:29.110922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece56e75-480c-4e82-bbb0-417dc600e4cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:29.112360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece56e75-480c-4e82-bbb0-417dc600e4cd None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:29.124696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 543/1083] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:29.130537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:29.236388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810909ce-400c-49b4-bf06-d4e9373defd0 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:29.268354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a8bc6-d6c4-4591-b2e6-6d5045a8b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:29.269231 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8bc6-d6c4-4591-b2e6-6d5045a8b656 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:29.269515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8bc6-d6c4-4591-b2e6-6d5045a8b656 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:29.269821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8bc6-d6c4-4591-b2e6-6d5045a8b656 None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/d42155dc7b5f42b79943f99952448202/roles/84b7ff3b93fb4ea697f86076cfbb0034` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:29.271999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a8bc6-d6c4-4591-b2e6-6d5045a8b656 None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=d42155dc7b5f42b79943f99952448202, role_id=84b7ff3b93fb4ea697f86076cfbb0034)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:29.273426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a8bc6-d6c4-4591-b2e6-6d5045a8b656 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:29.286609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 541/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:26:29 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/d42155dc7b5f42b79943f99952448202/roles/84b7ff3b93fb4ea697f86076cfbb0034 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:26:30.828275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd82e3-da92-4a7e-81de-3267c5b2e66f None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:30.828771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd82e3-da92-4a7e-81de-3267c5b2e66f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:30.828771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd82e3-da92-4a7e-81de-3267c5b2e66f None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:30.830111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 544/1085] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:30.835331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331840-e2e4-4a5f-9fbe-013db7abd83f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:30.835768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331840-e2e4-4a5f-9fbe-013db7abd83f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:30.835903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331840-e2e4-4a5f-9fbe-013db7abd83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:30.852589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-31331840-e2e4-4a5f-9fbe-013db7abd83f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:30.853789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-31331840-e2e4-4a5f-9fbe-013db7abd83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:30.916736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 542/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:30.940157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd82e3-da92-4a7e-81de-3267c5b2e66f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:31.034826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd82e3-da92-4a7e-81de-3267c5b2e66f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:31.066310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dda14-e2d1-4b7f-81a8-f98d574221ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:31.067088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dda14-e2d1-4b7f-81a8-f98d574221ea None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.067369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dda14-e2d1-4b7f-81a8-f98d574221ea None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.067639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dda14-e2d1-4b7f-81a8-f98d574221ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.078024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dda14-e2d1-4b7f-81a8-f98d574221ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-943dda14-e2d1-4b7f-81a8-f98d574221ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:31.085599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:31.086658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:31.087495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 545/1087] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:31.092661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31331840-e2e4-4a5f-9fbe-013db7abd83f None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:31.186976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31331840-e2e4-4a5f-9fbe-013db7abd83f None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:31.219594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:31.220254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.220533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.220800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.221548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:31.221863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:31.223212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:31.231201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 543/1088] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:31.236768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dda14-e2d1-4b7f-81a8-f98d574221ea None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:31.331049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dda14-e2d1-4b7f-81a8-f98d574221ea None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:31.361839 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebc429-cd1a-491c-9ad6-8441b8e0cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:31.362635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebc429-cd1a-491c-9ad6-8441b8e0cf12 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.362912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebc429-cd1a-491c-9ad6-8441b8e0cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.363185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebc429-cd1a-491c-9ad6-8441b8e0cf12 None admin] PATH_INFO: `/v3/users/4f9cd3c55d1b4638b56dd82c332e9613` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.364344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebc429-cd1a-491c-9ad6-8441b8e0cf12 None admin] RBAC: Authorizing `identity:get_user(user_id=4f9cd3c55d1b4638b56dd82c332e9613)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:31.365808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebc429-cd1a-491c-9ad6-8441b8e0cf12 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:31.367406 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 546/1089] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:31 2022] GET /identity/v3/users/4f9cd3c55d1b4638b56dd82c332e9613 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:31.373069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:31.471936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3806e1-0f6b-46de-9052-523219cdf467 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:31.503516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920a06-875b-4933-950f-386fff250b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:31.504158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920a06-875b-4933-950f-386fff250b19 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.504435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920a06-875b-4933-950f-386fff250b19 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.504704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920a06-875b-4933-950f-386fff250b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.567605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920a06-875b-4933-950f-386fff250b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:31.569045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920a06-875b-4933-950f-386fff250b19 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:31.571890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014017c-f1fe-4aea-940e-9a98cfc42627 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.572178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014017c-f1fe-4aea-940e-9a98cfc42627 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.572455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014017c-f1fe-4aea-940e-9a98cfc42627 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.573846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 547/1090] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:26:31.579521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8c108-c62c-4ed2-b01d-5d3a2581dc7f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.579810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8c108-c62c-4ed2-b01d-5d3a2581dc7f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.580090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8c108-c62c-4ed2-b01d-5d3a2581dc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.595920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e8a8c108-c62c-4ed2-b01d-5d3a2581dc7f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:31.597110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e8a8c108-c62c-4ed2-b01d-5d3a2581dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:31.659160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 548/1091] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:31.664580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 544/1092] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:26:31.665689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8c108-c62c-4ed2-b01d-5d3a2581dc7f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:31.683328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920a06-875b-4933-950f-386fff250b19 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:31.758613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8c108-c62c-4ed2-b01d-5d3a2581dc7f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:31.773374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920a06-875b-4933-950f-386fff250b19 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:31.789832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c591b-a242-4642-a16c-268bb26cbc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:31.790679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c591b-a242-4642-a16c-268bb26cbc03 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.790961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c591b-a242-4642-a16c-268bb26cbc03 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.791234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c591b-a242-4642-a16c-268bb26cbc03 None admin] PATH_INFO: `/v3/projects/e0880194ba40475ebed35dac6f0aff76` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.792409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c591b-a242-4642-a16c-268bb26cbc03 None admin] RBAC: Authorizing `identity:get_project(project_id=e0880194ba40475ebed35dac6f0aff76)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:31.793875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c591b-a242-4642-a16c-268bb26cbc03 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:31.795549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 549/1093] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:31 2022] GET /identity/v3/projects/e0880194ba40475ebed35dac6f0aff76 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:31.801857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c591b-a242-4642-a16c-268bb26cbc03 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:31.806302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a731b-6a7f-496b-a144-6a3236a7fbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:31.807095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a731b-6a7f-496b-a144-6a3236a7fbbf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.807375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a731b-6a7f-496b-a144-6a3236a7fbbf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.807641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a731b-6a7f-496b-a144-6a3236a7fbbf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.817978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a731b-6a7f-496b-a144-6a3236a7fbbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-b06a731b-6a7f-496b-a144-6a3236a7fbbf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:31.826089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:31.827039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:31.828948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 545/1094] 10.222.0.36 () {56 vars in 1120 bytes} [Wed May 11 07:26:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:31.833125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a731b-6a7f-496b-a144-6a3236a7fbbf None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:31.896244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c591b-a242-4642-a16c-268bb26cbc03 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:31.924258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a731b-6a7f-496b-a144-6a3236a7fbbf None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:31.927989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:31.928639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.928924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.929201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.930049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=e0880194ba40475ebed35dac6f0aff76, user.id=4f9cd3c55d1b4638b56dd82c332e9613) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:31.930366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:31.931791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:31.938211 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 550/1095] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:31 2022] GET /identity/v3/role_assignments?user.id=4f9cd3c55d1b4638b56dd82c332e9613&scope.project.id=e0880194ba40475ebed35dac6f0aff76&role.id=de114c58fdc8476ebab657e6f9359155 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:31.957491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:31.958212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:31.958502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:31.958777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:31.959545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:31.959858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:31.961269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:31.975653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 546/1096] 10.222.0.36 () {56 vars in 1115 bytes} [Wed May 11 07:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:26:31.976906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:32.078188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48329c-c5f4-4cf7-98b6-5e79a4ea05a7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:32.112191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:32.112994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:32.113278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:32.113578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:32.124454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:32.125956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:32.143218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:32.144190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:32.145099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:32.145099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:32.145099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:32.145099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:32.145099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 551/1097] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:32.150178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:32.251673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aa47f-8475-4339-8865-ea7bb97fd8f3 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:32.282855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:32.283511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:32.283794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:32.284066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:32.284785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:32.285089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:32.286469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:32.298386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 547/1098] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:32.304547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:32.400465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db0ef2-7a2e-4212-9d1a-d9954ad86de2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:32.432151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:32.432928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:32.433208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:32.433484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:32.441941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:32.444440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:26:32.459813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:32.460927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:32.462412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 552/1099] 10.222.0.36 () {56 vars in 1093 bytes} [Wed May 11 07:26:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:32.466646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:32.559852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e17841-26ca-4bee-a85b-3c7fc2654637 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:32.591732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:32.592390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:32.592670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:32.593533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:32.594379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:32.594688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:32.596097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:32.612606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 548/1100] 10.222.0.36 () {56 vars in 1133 bytes} [Wed May 11 07:26:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:32.618258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:32.711273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9109-8b55-41ba-91e2-d997ecf2c64a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:32.743047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2685-69ff-4902-bd79-67af4511efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:32.743691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2685-69ff-4902-bd79-67af4511efed None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:32.743977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2685-69ff-4902-bd79-67af4511efed None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:32.744255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d2685-69ff-4902-bd79-67af4511efed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:32.807473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d2685-69ff-4902-bd79-67af4511efed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:32.808914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d2685-69ff-4902-bd79-67af4511efed None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:32.899805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 553/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:26:32.905636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:32.996039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9728f0-785f-441a-a912-46dd5cbf0ecf None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:33.027972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:33.028743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:33.029020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:33.029285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:33.038697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:33.040121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:26:33.056694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:33.057636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:33.058537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:26:33.058537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:26:33.058537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:26:33.058537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:33.058537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 549/1102] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:33.064447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2685-69ff-4902-bd79-67af4511efed None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:33.158582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d2685-69ff-4902-bd79-67af4511efed None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:33.190997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:33.191646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:33.191925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:33.192195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:33.192899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:33.193200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:33.194581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:33.205198 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 554/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:33.210810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:33.309617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c940e-89ba-450a-b284-f23f219163b6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:33.341355 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:33.342164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:33.342446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:33.342757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:33.348950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:33.350414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:26:33.364469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:33.365606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:33.371830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 550/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:26:33.372447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:33.464789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf2de-9c79-43df-8ed1-49c059b3830f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:33.497042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01a0f6-5d3b-4e73-b185-29d8cba8d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:33.497732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01a0f6-5d3b-4e73-b185-29d8cba8d134 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:33.498019 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01a0f6-5d3b-4e73-b185-29d8cba8d134 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:33.498294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01a0f6-5d3b-4e73-b185-29d8cba8d134 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:33.499077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01a0f6-5d3b-4e73-b185-29d8cba8d134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:33.499390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01a0f6-5d3b-4e73-b185-29d8cba8d134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:33.500816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01a0f6-5d3b-4e73-b185-29d8cba8d134 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:33.512293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 555/1105] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:33.518437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:33.612110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc385e0-ba52-4ef5-ba34-dbabbbfcf0b1 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:33.642965 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283b557-1bbe-4ccd-a3a1-20390f4a85ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:33.643608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b557-1bbe-4ccd-a3a1-20390f4a85ec None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:33.643886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b557-1bbe-4ccd-a3a1-20390f4a85ec None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:33.644155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283b557-1bbe-4ccd-a3a1-20390f4a85ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:33.644974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283b557-1bbe-4ccd-a3a1-20390f4a85ec None admin] RBAC: Adding query filter params (role.id=84b7ff3b93fb4ea697f86076cfbb0034, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=d42155dc7b5f42b79943f99952448202) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:33.645284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283b557-1bbe-4ccd-a3a1-20390f4a85ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:33.646731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283b557-1bbe-4ccd-a3a1-20390f4a85ec None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:33.652313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 551/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:33 2022] GET /identity/v3/role_assignments?user.id=d42155dc7b5f42b79943f99952448202&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=84b7ff3b93fb4ea697f86076cfbb0034 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:34.176220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526039-ba4c-40bb-88b4-1534fe749809 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:34.176757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526039-ba4c-40bb-88b4-1534fe749809 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:34.176757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526039-ba4c-40bb-88b4-1534fe749809 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:34.178171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 556/1107] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:34.183541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0ff11-5d24-4115-b8ae-1601ccebba75 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:34.183953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0ff11-5d24-4115-b8ae-1601ccebba75 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:34.184105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0ff11-5d24-4115-b8ae-1601ccebba75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:34.200969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-dbb0ff11-5d24-4115-b8ae-1601ccebba75 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:34.202715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-dbb0ff11-5d24-4115-b8ae-1601ccebba75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:34.267056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 552/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:34.291052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526039-ba4c-40bb-88b4-1534fe749809 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:34.396514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526039-ba4c-40bb-88b4-1534fe749809 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:34.428817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60129799-ed46-4a70-a51c-d39a6a1f301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:34.429531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129799-ed46-4a70-a51c-d39a6a1f301c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:34.429844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129799-ed46-4a70-a51c-d39a6a1f301c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:34.430113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60129799-ed46-4a70-a51c-d39a6a1f301c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:34.431276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60129799-ed46-4a70-a51c-d39a6a1f301c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:34.432697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60129799-ed46-4a70-a51c-d39a6a1f301c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:34.434328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 557/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:34.441054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0ff11-5d24-4115-b8ae-1601ccebba75 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:34.542976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0ff11-5d24-4115-b8ae-1601ccebba75 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:34.574997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab7eac-e7c5-42e1-a138-7ae9b82f3ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:34.575662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7eac-e7c5-42e1-a138-7ae9b82f3ddf None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:34.575948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7eac-e7c5-42e1-a138-7ae9b82f3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:34.576224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7eac-e7c5-42e1-a138-7ae9b82f3ddf None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:34.576944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7eac-e7c5-42e1-a138-7ae9b82f3ddf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:34.579072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7eac-e7c5-42e1-a138-7ae9b82f3ddf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:34.597626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 553/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:26:34 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:26:36.824121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246b8d-8dcf-4dc4-8b49-1b83d597de61 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:36.824718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246b8d-8dcf-4dc4-8b49-1b83d597de61 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:36.824718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246b8d-8dcf-4dc4-8b49-1b83d597de61 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:36.826500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 558/1111] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:36.832159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560d9f-2e1b-420d-880b-493759487d86 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:36.832598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560d9f-2e1b-420d-880b-493759487d86 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:36.832704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85560d9f-2e1b-420d-880b-493759487d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:36.849347 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-85560d9f-2e1b-420d-880b-493759487d86 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:36.850529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-85560d9f-2e1b-420d-880b-493759487d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:36.914963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 554/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:36.939265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f246b8d-8dcf-4dc4-8b49-1b83d597de61 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:37.033336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f246b8d-8dcf-4dc4-8b49-1b83d597de61 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:37.065379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adfffb-b01f-4acb-8bab-a457d17f2aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:37.066248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adfffb-b01f-4acb-8bab-a457d17f2aaa None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:37.066537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adfffb-b01f-4acb-8bab-a457d17f2aaa None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:37.066811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adfffb-b01f-4acb-8bab-a457d17f2aaa None admin] PATH_INFO: `/v3/roles/aa78a08951eb49f78aeda141988844de` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:37.068271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adfffb-b01f-4acb-8bab-a457d17f2aaa None admin] RBAC: Authorizing `identity:get_role(role_id=aa78a08951eb49f78aeda141988844de)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:37.069690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adfffb-b01f-4acb-8bab-a457d17f2aaa None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:37.071012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 559/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:36 2022] GET /identity/v3/roles/aa78a08951eb49f78aeda141988844de => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:37.076699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560d9f-2e1b-420d-880b-493759487d86 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:37.177089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85560d9f-2e1b-420d-880b-493759487d86 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:37.208917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e85dd5-c800-40de-9864-55bdb1b4bd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:37.209805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e85dd5-c800-40de-9864-55bdb1b4bd6a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:37.210092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e85dd5-c800-40de-9864-55bdb1b4bd6a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:37.210371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e85dd5-c800-40de-9864-55bdb1b4bd6a None admin] PATH_INFO: `/v3/users/10426d9377374191afaaeb7720b06d3d` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:37.223166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e85dd5-c800-40de-9864-55bdb1b4bd6a None admin] RBAC: Authorizing `identity:get_user(user_id=10426d9377374191afaaeb7720b06d3d)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:37.224655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e85dd5-c800-40de-9864-55bdb1b4bd6a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:37.226320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 555/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:37 2022] GET /identity/v3/users/10426d9377374191afaaeb7720b06d3d => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:37.232127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adfffb-b01f-4acb-8bab-a457d17f2aaa None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:37.324243 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adfffb-b01f-4acb-8bab-a457d17f2aaa None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:37.355522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf330-1201-4bba-98c9-a659b0ec16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:37.356097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf330-1201-4bba-98c9-a659b0ec16db None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:37.356379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf330-1201-4bba-98c9-a659b0ec16db None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:37.356649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf330-1201-4bba-98c9-a659b0ec16db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:37.425074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbf330-1201-4bba-98c9-a659b0ec16db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:37.426547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbf330-1201-4bba-98c9-a659b0ec16db None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:37.524323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 560/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:26:37.530839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e85dd5-c800-40de-9864-55bdb1b4bd6a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:37.624252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e85dd5-c800-40de-9864-55bdb1b4bd6a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:37.656312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e645d-c38a-4b64-a330-2efbc2a328bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:37.657148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e645d-c38a-4b64-a330-2efbc2a328bf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:37.657433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e645d-c38a-4b64-a330-2efbc2a328bf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:37.657862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e645d-c38a-4b64-a330-2efbc2a328bf None admin] PATH_INFO: `/v3/projects/e0880194ba40475ebed35dac6f0aff76` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:37.659028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e645d-c38a-4b64-a330-2efbc2a328bf None admin] RBAC: Authorizing `identity:get_project(project_id=e0880194ba40475ebed35dac6f0aff76)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:37.660440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e645d-c38a-4b64-a330-2efbc2a328bf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:37.662141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 556/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:37 2022] GET /identity/v3/projects/e0880194ba40475ebed35dac6f0aff76 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:37.667986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf330-1201-4bba-98c9-a659b0ec16db None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:37.758751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbf330-1201-4bba-98c9-a659b0ec16db None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:37.798431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cdd09-5fb0-49d3-9fb4-22e802cad554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:37.799078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cdd09-5fb0-49d3-9fb4-22e802cad554 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:37.799357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cdd09-5fb0-49d3-9fb4-22e802cad554 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:37.799626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cdd09-5fb0-49d3-9fb4-22e802cad554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:37.800514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cdd09-5fb0-49d3-9fb4-22e802cad554 None admin] RBAC: Adding query filter params (role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=e0880194ba40475ebed35dac6f0aff76, user.id=10426d9377374191afaaeb7720b06d3d) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:37.800824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cdd09-5fb0-49d3-9fb4-22e802cad554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:37.802290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cdd09-5fb0-49d3-9fb4-22e802cad554 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:37.808890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 561/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:37 2022] GET /identity/v3/role_assignments?user.id=10426d9377374191afaaeb7720b06d3d&scope.project.id=e0880194ba40475ebed35dac6f0aff76&role.id=aa78a08951eb49f78aeda141988844de => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:39.963348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af3cd-ca15-4a3d-b06a-8580d0619510 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:39.963871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af3cd-ca15-4a3d-b06a-8580d0619510 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:39.963984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129af3cd-ca15-4a3d-b06a-8580d0619510 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:39.965256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 557/1118] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:39.970418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed677-3615-4c7f-8a96-101bd884f394 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:39.970787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed677-3615-4c7f-8a96-101bd884f394 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:39.970982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed677-3615-4c7f-8a96-101bd884f394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:39.987616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6aaed677-3615-4c7f-8a96-101bd884f394 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:39.988789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6aaed677-3615-4c7f-8a96-101bd884f394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:40.051402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 562/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:40.073942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129af3cd-ca15-4a3d-b06a-8580d0619510 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:40.171237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129af3cd-ca15-4a3d-b06a-8580d0619510 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:40.203595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e1f44-637b-4349-9da6-d8390360aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:40.204438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e1f44-637b-4349-9da6-d8390360aa0a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:40.204720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e1f44-637b-4349-9da6-d8390360aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:40.204995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e1f44-637b-4349-9da6-d8390360aa0a None admin] PATH_INFO: `/v3/roles/aa78a08951eb49f78aeda141988844de` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:40.206480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e1f44-637b-4349-9da6-d8390360aa0a None admin] RBAC: Authorizing `identity:get_role(role_id=aa78a08951eb49f78aeda141988844de)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:40.207840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e1f44-637b-4349-9da6-d8390360aa0a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:40.209191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 558/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:40 2022] GET /identity/v3/roles/aa78a08951eb49f78aeda141988844de => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:40.215025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed677-3615-4c7f-8a96-101bd884f394 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:40.307065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed677-3615-4c7f-8a96-101bd884f394 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:40.338103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54d5b7-e6cd-4932-b409-e1018478c139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:40.338949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54d5b7-e6cd-4932-b409-e1018478c139 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:40.339227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54d5b7-e6cd-4932-b409-e1018478c139 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:40.339497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54d5b7-e6cd-4932-b409-e1018478c139 None admin] PATH_INFO: `/v3/users/10426d9377374191afaaeb7720b06d3d` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:40.340816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54d5b7-e6cd-4932-b409-e1018478c139 None admin] RBAC: Authorizing `identity:get_user(user_id=10426d9377374191afaaeb7720b06d3d)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:40.342276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54d5b7-e6cd-4932-b409-e1018478c139 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:40.344381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 563/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:40 2022] GET /identity/v3/users/10426d9377374191afaaeb7720b06d3d => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:40.350022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e1f44-637b-4349-9da6-d8390360aa0a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:40.442192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e1f44-637b-4349-9da6-d8390360aa0a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:40.475073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ceddd-6be5-4c85-84d2-fe67b2c07236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:40.475858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ceddd-6be5-4c85-84d2-fe67b2c07236 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:40.476137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ceddd-6be5-4c85-84d2-fe67b2c07236 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:40.476408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ceddd-6be5-4c85-84d2-fe67b2c07236 None admin] PATH_INFO: `/v3/projects/e0880194ba40475ebed35dac6f0aff76` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:40.477573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ceddd-6be5-4c85-84d2-fe67b2c07236 None admin] RBAC: Authorizing `identity:get_project(project_id=e0880194ba40475ebed35dac6f0aff76)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:40.478989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ceddd-6be5-4c85-84d2-fe67b2c07236 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:40.480676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 559/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:40 2022] GET /identity/v3/projects/e0880194ba40475ebed35dac6f0aff76 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:40.487244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54d5b7-e6cd-4932-b409-e1018478c139 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:40.579463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54d5b7-e6cd-4932-b409-e1018478c139 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:40.611762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ac6a1-ef2e-4091-bcaf-cf677bdf2bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:40.612628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ac6a1-ef2e-4091-bcaf-cf677bdf2bec None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:40.612906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ac6a1-ef2e-4091-bcaf-cf677bdf2bec None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:40.613172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ac6a1-ef2e-4091-bcaf-cf677bdf2bec None admin] PATH_INFO: `/v3/projects/e0880194ba40475ebed35dac6f0aff76/users/10426d9377374191afaaeb7720b06d3d/roles/aa78a08951eb49f78aeda141988844de` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:40.615343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ac6a1-ef2e-4091-bcaf-cf677bdf2bec None admin] RBAC: Authorizing `identity:create_grant(project_id=e0880194ba40475ebed35dac6f0aff76, user_id=10426d9377374191afaaeb7720b06d3d, role_id=aa78a08951eb49f78aeda141988844de)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:40.616756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ac6a1-ef2e-4091-bcaf-cf677bdf2bec None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:40.628489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 564/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:26:40 2022] PUT /identity/v3/projects/e0880194ba40475ebed35dac6f0aff76/users/10426d9377374191afaaeb7720b06d3d/roles/aa78a08951eb49f78aeda141988844de => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:26:42.809394 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccc2e1-bb37-46fa-950b-8ec838a394bc None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:42.809951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccc2e1-bb37-46fa-950b-8ec838a394bc None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:42.809951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccc2e1-bb37-46fa-950b-8ec838a394bc None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:42.811765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 560/1124] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:42.817226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb17d-1406-401a-8533-2775cc308ce7 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:42.817648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb17d-1406-401a-8533-2775cc308ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:42.817798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb17d-1406-401a-8533-2775cc308ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:42.834295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f96fb17d-1406-401a-8533-2775cc308ce7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:42.835468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f96fb17d-1406-401a-8533-2775cc308ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:42.896430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 565/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:42.919100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccc2e1-bb37-46fa-950b-8ec838a394bc None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:43.015436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccc2e1-bb37-46fa-950b-8ec838a394bc None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:43.047894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea91310-8e9b-4290-95b4-ee430dd16f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:43.048720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea91310-8e9b-4290-95b4-ee430dd16f24 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:43.048995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea91310-8e9b-4290-95b4-ee430dd16f24 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:43.049264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea91310-8e9b-4290-95b4-ee430dd16f24 None admin] PATH_INFO: `/v3/roles/aa78a08951eb49f78aeda141988844de` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:43.050728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea91310-8e9b-4290-95b4-ee430dd16f24 None admin] RBAC: Authorizing `identity:get_role(role_id=aa78a08951eb49f78aeda141988844de)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:43.052071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea91310-8e9b-4290-95b4-ee430dd16f24 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:43.053397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 561/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:42 2022] GET /identity/v3/roles/aa78a08951eb49f78aeda141988844de => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:43.058864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb17d-1406-401a-8533-2775cc308ce7 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:43.149030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb17d-1406-401a-8533-2775cc308ce7 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:43.180041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f482b-f375-471f-bd0a-942e9ce89ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:43.180901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f482b-f375-471f-bd0a-942e9ce89ae3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:43.181184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f482b-f375-471f-bd0a-942e9ce89ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:43.181458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f482b-f375-471f-bd0a-942e9ce89ae3 None admin] PATH_INFO: `/v3/users/10426d9377374191afaaeb7720b06d3d` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:43.182654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f482b-f375-471f-bd0a-942e9ce89ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=10426d9377374191afaaeb7720b06d3d)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:43.184073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f482b-f375-471f-bd0a-942e9ce89ae3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:43.185694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 566/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:43 2022] GET /identity/v3/users/10426d9377374191afaaeb7720b06d3d => generated 286 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:43.191750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea91310-8e9b-4290-95b4-ee430dd16f24 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:43.283650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea91310-8e9b-4290-95b4-ee430dd16f24 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:43.315272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d437bb-8912-466b-a08b-5f32fa929b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:43.315894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d437bb-8912-466b-a08b-5f32fa929b71 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:43.316174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d437bb-8912-466b-a08b-5f32fa929b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:43.316446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d437bb-8912-466b-a08b-5f32fa929b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:43.377947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d437bb-8912-466b-a08b-5f32fa929b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:43.379360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d437bb-8912-466b-a08b-5f32fa929b71 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:43.469289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 562/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 07:26:43.475074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f482b-f375-471f-bd0a-942e9ce89ae3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:43.567079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f482b-f375-471f-bd0a-942e9ce89ae3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:43.598640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a416249-f1c3-4a76-a289-53908df0811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:43.599472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a416249-f1c3-4a76-a289-53908df0811e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:43.599751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a416249-f1c3-4a76-a289-53908df0811e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:43.600020 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a416249-f1c3-4a76-a289-53908df0811e None admin] PATH_INFO: `/v3/projects/e0880194ba40475ebed35dac6f0aff76` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:43.601164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a416249-f1c3-4a76-a289-53908df0811e None admin] RBAC: Authorizing `identity:get_project(project_id=e0880194ba40475ebed35dac6f0aff76)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:43.602616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a416249-f1c3-4a76-a289-53908df0811e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:43.604259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 567/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:43 2022] GET /identity/v3/projects/e0880194ba40475ebed35dac6f0aff76 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:43.610199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d437bb-8912-466b-a08b-5f32fa929b71 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:43.701043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d437bb-8912-466b-a08b-5f32fa929b71 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:43.732768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587395f-d5df-4590-9204-d45b70ec6a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:43.733368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587395f-d5df-4590-9204-d45b70ec6a47 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:43.733672 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587395f-d5df-4590-9204-d45b70ec6a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:43.733942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587395f-d5df-4590-9204-d45b70ec6a47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:43.734761 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587395f-d5df-4590-9204-d45b70ec6a47 None admin] RBAC: Adding query filter params (role.id=aa78a08951eb49f78aeda141988844de, scope.project.id=e0880194ba40475ebed35dac6f0aff76, user.id=10426d9377374191afaaeb7720b06d3d) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:43.735067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587395f-d5df-4590-9204-d45b70ec6a47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:43.736468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587395f-d5df-4590-9204-d45b70ec6a47 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:43.741964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 563/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:43 2022] GET /identity/v3/role_assignments?user.id=10426d9377374191afaaeb7720b06d3d&scope.project.id=e0880194ba40475ebed35dac6f0aff76&role.id=aa78a08951eb49f78aeda141988844de => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:45.932540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716de2-e9b9-4d5a-adc1-4dfdb89520b5 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:45.933069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716de2-e9b9-4d5a-adc1-4dfdb89520b5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:45.933069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716de2-e9b9-4d5a-adc1-4dfdb89520b5 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:45.934456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 568/1131] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:45.940623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96406-fb6a-4c35-8aed-cf59f94f713a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:45.940989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96406-fb6a-4c35-8aed-cf59f94f713a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:45.941180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96406-fb6a-4c35-8aed-cf59f94f713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:45.957285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-22f96406-fb6a-4c35-8aed-cf59f94f713a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:45.958501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-22f96406-fb6a-4c35-8aed-cf59f94f713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:46.020546 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 564/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:46.043184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716de2-e9b9-4d5a-adc1-4dfdb89520b5 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:46.136372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716de2-e9b9-4d5a-adc1-4dfdb89520b5 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:46.171936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df492bdc-e3bb-4ba0-80e5-a7d7553dd708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:46.172713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df492bdc-e3bb-4ba0-80e5-a7d7553dd708 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:46.172990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df492bdc-e3bb-4ba0-80e5-a7d7553dd708 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:46.173411 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df492bdc-e3bb-4ba0-80e5-a7d7553dd708 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:46.174453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df492bdc-e3bb-4ba0-80e5-a7d7553dd708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:46.175886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df492bdc-e3bb-4ba0-80e5-a7d7553dd708 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:46.177473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 569/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:46.184123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96406-fb6a-4c35-8aed-cf59f94f713a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:46.275629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f96406-fb6a-4c35-8aed-cf59f94f713a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:46.307800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55c3e0-6c6f-4e29-a987-4abcebc025c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:46.308452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55c3e0-6c6f-4e29-a987-4abcebc025c9 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:46.308737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55c3e0-6c6f-4e29-a987-4abcebc025c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:46.309011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55c3e0-6c6f-4e29-a987-4abcebc025c9 None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:46.309743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55c3e0-6c6f-4e29-a987-4abcebc025c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:46.311189 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55c3e0-6c6f-4e29-a987-4abcebc025c9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:46.334928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 565/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:26:46 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:48.558357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95614-2d52-4b10-9ab5-b5b0c4766005 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:48.558859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95614-2d52-4b10-9ab5-b5b0c4766005 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:48.558949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de95614-2d52-4b10-9ab5-b5b0c4766005 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:48.560234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 570/1135] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:48.565703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133ba4-54e6-4d02-95b8-2bf0a9602e0e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:48.566113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133ba4-54e6-4d02-95b8-2bf0a9602e0e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:48.566253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133ba4-54e6-4d02-95b8-2bf0a9602e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:48.582882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4c133ba4-54e6-4d02-95b8-2bf0a9602e0e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:48.584033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4c133ba4-54e6-4d02-95b8-2bf0a9602e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:48.645260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 566/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:48.669644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de95614-2d52-4b10-9ab5-b5b0c4766005 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:48.763768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de95614-2d52-4b10-9ab5-b5b0c4766005 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:48.795032 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2f6c5-3304-4fc8-a259-aa1fea17034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:48.796378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f6c5-3304-4fc8-a259-aa1fea17034d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:48.796659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f6c5-3304-4fc8-a259-aa1fea17034d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:48.796935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f6c5-3304-4fc8-a259-aa1fea17034d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:48.798114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2f6c5-3304-4fc8-a259-aa1fea17034d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:48.799531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2f6c5-3304-4fc8-a259-aa1fea17034d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:48.801090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 571/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:26:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:48.806450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133ba4-54e6-4d02-95b8-2bf0a9602e0e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:48.899201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133ba4-54e6-4d02-95b8-2bf0a9602e0e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:48.930664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500e379-3cae-4fe9-baa2-2a14ffc4995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:48.931315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e379-3cae-4fe9-baa2-2a14ffc4995d None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:48.931599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e379-3cae-4fe9-baa2-2a14ffc4995d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:48.931874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500e379-3cae-4fe9-baa2-2a14ffc4995d None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:48.932578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500e379-3cae-4fe9-baa2-2a14ffc4995d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:48.934052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500e379-3cae-4fe9-baa2-2a14ffc4995d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:48.953146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 567/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:26:48 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:26:51.166679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf701a-a74e-4843-961c-a25db756c601 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:51.167208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf701a-a74e-4843-961c-a25db756c601 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:51.167208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf701a-a74e-4843-961c-a25db756c601 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:51.168570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 572/1139] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:51.174290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444f65a-fdb8-4c5b-a613-c735afe645d6 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:51.174686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444f65a-fdb8-4c5b-a613-c735afe645d6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:51.174849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444f65a-fdb8-4c5b-a613-c735afe645d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:51.191780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b444f65a-fdb8-4c5b-a613-c735afe645d6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:51.192958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b444f65a-fdb8-4c5b-a613-c735afe645d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:51.254888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 568/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:26:51.277827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf701a-a74e-4843-961c-a25db756c601 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:51.371114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf701a-a74e-4843-961c-a25db756c601 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:51.402295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42219f-5b9d-4e55-89af-a660e6f17dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:51.403059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42219f-5b9d-4e55-89af-a660e6f17dd4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:51.403340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42219f-5b9d-4e55-89af-a660e6f17dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:51.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42219f-5b9d-4e55-89af-a660e6f17dd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:51.413018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42219f-5b9d-4e55-89af-a660e6f17dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-bb42219f-5b9d-4e55-89af-a660e6f17dd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:51.421607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:51.422860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:51.423870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 573/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:51.428423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444f65a-fdb8-4c5b-a613-c735afe645d6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:51.521050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444f65a-fdb8-4c5b-a613-c735afe645d6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:51.552921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:51.553591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:51.553878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:51.554153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:51.554889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:51.555196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:51.556550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:51.564350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 569/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:51.570037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42219f-5b9d-4e55-89af-a660e6f17dd4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:51.662964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42219f-5b9d-4e55-89af-a660e6f17dd4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:51.694455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087bf5-ddbd-4102-a75c-3e750d112b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:51.695276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087bf5-ddbd-4102-a75c-3e750d112b53 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:51.695538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087bf5-ddbd-4102-a75c-3e750d112b53 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:51.695811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff087bf5-ddbd-4102-a75c-3e750d112b53 None admin] PATH_INFO: `/v3/users/c720e25348794b9a914cc326b26a30cc` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:51.707961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff087bf5-ddbd-4102-a75c-3e750d112b53 None admin] RBAC: Authorizing `identity:get_user(user_id=c720e25348794b9a914cc326b26a30cc)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:51.709389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff087bf5-ddbd-4102-a75c-3e750d112b53 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:51.711012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 574/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:51 2022] GET /identity/v3/users/c720e25348794b9a914cc326b26a30cc => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:51.716687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:51.809147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4070e-423a-4b63-a254-9a0174f859fe None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:51.860708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c811a2-e45b-4ded-bd43-57a90fb9bdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:51.861375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c811a2-e45b-4ded-bd43-57a90fb9bdc6 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:51.861691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c811a2-e45b-4ded-bd43-57a90fb9bdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:51.862217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c811a2-e45b-4ded-bd43-57a90fb9bdc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:51.924913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c811a2-e45b-4ded-bd43-57a90fb9bdc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:51.926381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c811a2-e45b-4ded-bd43-57a90fb9bdc6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:52.019388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 570/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:26:52.025172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087bf5-ddbd-4102-a75c-3e750d112b53 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:52.116693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff087bf5-ddbd-4102-a75c-3e750d112b53 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:52.147977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4ac89-0ae1-4055-a487-bb35e194c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:52.148818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ac89-0ae1-4055-a487-bb35e194c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:52.149098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ac89-0ae1-4055-a487-bb35e194c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:52.149365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4ac89-0ae1-4055-a487-bb35e194c4f2 None admin] PATH_INFO: `/v3/projects/dab0ea8c304d4d5db3a3ccbb02f4b695` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:52.150544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4ac89-0ae1-4055-a487-bb35e194c4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=dab0ea8c304d4d5db3a3ccbb02f4b695)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:52.151957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4ac89-0ae1-4055-a487-bb35e194c4f2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:52.153791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 575/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:52 2022] GET /identity/v3/projects/dab0ea8c304d4d5db3a3ccbb02f4b695 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:52.159901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c811a2-e45b-4ded-bd43-57a90fb9bdc6 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:52.255909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c811a2-e45b-4ded-bd43-57a90fb9bdc6 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:52.287888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fa0c8-221f-47bb-b669-1e25bb664bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:52.288473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa0c8-221f-47bb-b669-1e25bb664bab None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:52.288753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa0c8-221f-47bb-b669-1e25bb664bab None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:52.289025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fa0c8-221f-47bb-b669-1e25bb664bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:52.289866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fa0c8-221f-47bb-b669-1e25bb664bab None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=dab0ea8c304d4d5db3a3ccbb02f4b695, user.id=c720e25348794b9a914cc326b26a30cc) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:52.290181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fa0c8-221f-47bb-b669-1e25bb664bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:52.291594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fa0c8-221f-47bb-b669-1e25bb664bab None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:52.296792 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 571/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:52 2022] GET /identity/v3/role_assignments?user.id=c720e25348794b9a914cc326b26a30cc&scope.project.id=dab0ea8c304d4d5db3a3ccbb02f4b695&role.id=de114c58fdc8476ebab657e6f9359155 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:54.492773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec907f5-c7e5-435c-9367-73957146be0b None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:54.493157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec907f5-c7e5-435c-9367-73957146be0b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:54.493330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec907f5-c7e5-435c-9367-73957146be0b None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:54.494725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 576/1147] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:54.499958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b725-9ca5-4b1d-9195-172935e1d6de None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:54.500376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b725-9ca5-4b1d-9195-172935e1d6de None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:54.500507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b725-9ca5-4b1d-9195-172935e1d6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:54.516571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5f81b725-9ca5-4b1d-9195-172935e1d6de None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:54.517757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5f81b725-9ca5-4b1d-9195-172935e1d6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:54.578782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 572/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:54.600982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec907f5-c7e5-435c-9367-73957146be0b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:54.696417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec907f5-c7e5-435c-9367-73957146be0b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:54.727541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac013d-ea52-455a-b41c-c5b1e5a2add3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:54.728315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac013d-ea52-455a-b41c-c5b1e5a2add3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:54.728594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac013d-ea52-455a-b41c-c5b1e5a2add3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:54.728864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac013d-ea52-455a-b41c-c5b1e5a2add3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:54.738964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac013d-ea52-455a-b41c-c5b1e5a2add3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-e8ac013d-ea52-455a-b41c-c5b1e5a2add3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:54.746511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:54.747588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:26:54.748498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 577/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:54.753670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b725-9ca5-4b1d-9195-172935e1d6de None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:54.845060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b725-9ca5-4b1d-9195-172935e1d6de None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:54.875964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:54.876607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:54.876885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:54.877154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:54.877914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:54.878218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:54.879566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:54.887049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 573/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:54.893143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac013d-ea52-455a-b41c-c5b1e5a2add3 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:54.985990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac013d-ea52-455a-b41c-c5b1e5a2add3 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:55.016672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5589c5e-e985-4c9a-a31b-e5b12215990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:55.017460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589c5e-e985-4c9a-a31b-e5b12215990e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:55.017767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589c5e-e985-4c9a-a31b-e5b12215990e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:55.018042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589c5e-e985-4c9a-a31b-e5b12215990e None admin] PATH_INFO: `/v3/users/c720e25348794b9a914cc326b26a30cc` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:55.019205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5589c5e-e985-4c9a-a31b-e5b12215990e None admin] RBAC: Authorizing `identity:get_user(user_id=c720e25348794b9a914cc326b26a30cc)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:55.020611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5589c5e-e985-4c9a-a31b-e5b12215990e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:55.022218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 578/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:54 2022] GET /identity/v3/users/c720e25348794b9a914cc326b26a30cc => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:55.027687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:55.119600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c7821-4311-43c2-9757-320c60f3389a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:55.150109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07462c1-c7f5-43a3-9def-e615ae656d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:55.150936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07462c1-c7f5-43a3-9def-e615ae656d08 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:55.151224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07462c1-c7f5-43a3-9def-e615ae656d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:55.151493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07462c1-c7f5-43a3-9def-e615ae656d08 None admin] PATH_INFO: `/v3/projects/dab0ea8c304d4d5db3a3ccbb02f4b695` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:55.152637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07462c1-c7f5-43a3-9def-e615ae656d08 None admin] RBAC: Authorizing `identity:get_project(project_id=dab0ea8c304d4d5db3a3ccbb02f4b695)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:55.154066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07462c1-c7f5-43a3-9def-e615ae656d08 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:55.156244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 574/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:55 2022] GET /identity/v3/projects/dab0ea8c304d4d5db3a3ccbb02f4b695 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:55.161688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5589c5e-e985-4c9a-a31b-e5b12215990e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:55.253447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5589c5e-e985-4c9a-a31b-e5b12215990e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:55.284731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead3c4-6177-45f4-a93f-94b26463c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:55.285561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead3c4-6177-45f4-a93f-94b26463c8b8 None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:55.285843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead3c4-6177-45f4-a93f-94b26463c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:55.286112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead3c4-6177-45f4-a93f-94b26463c8b8 None admin] PATH_INFO: `/v3/projects/dab0ea8c304d4d5db3a3ccbb02f4b695/users/c720e25348794b9a914cc326b26a30cc/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:55.288021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead3c4-6177-45f4-a93f-94b26463c8b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dab0ea8c304d4d5db3a3ccbb02f4b695, user_id=c720e25348794b9a914cc326b26a30cc, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:55.289438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead3c4-6177-45f4-a93f-94b26463c8b8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:55.302729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 579/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:26:55 2022] PUT /identity/v3/projects/dab0ea8c304d4d5db3a3ccbb02f4b695/users/c720e25348794b9a914cc326b26a30cc/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:26:57.463090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d5fa-3dd5-425d-a304-37b005a7dfb9 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:57.463626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d5fa-3dd5-425d-a304-37b005a7dfb9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:57.463626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d5fa-3dd5-425d-a304-37b005a7dfb9 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:57.464990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 575/1154] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:26:57.470632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332dac-5155-4035-a42c-c5661fbf3ff6 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:57.471030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332dac-5155-4035-a42c-c5661fbf3ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:57.471189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b332dac-5155-4035-a42c-c5661fbf3ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:57.487968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6b332dac-5155-4035-a42c-c5661fbf3ff6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:26:57.489156 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6b332dac-5155-4035-a42c-c5661fbf3ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:26:57.550408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 580/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:26:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:26:57.573799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32d5fa-3dd5-425d-a304-37b005a7dfb9 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:57.666784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32d5fa-3dd5-425d-a304-37b005a7dfb9 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:57.699231 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edc29e-e61d-4632-b787-c202525fef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:57.700003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc29e-e61d-4632-b787-c202525fef80 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:57.700280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc29e-e61d-4632-b787-c202525fef80 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:57.700544 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edc29e-e61d-4632-b787-c202525fef80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:57.710371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edc29e-e61d-4632-b787-c202525fef80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-62edc29e-e61d-4632-b787-c202525fef80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:26:57.718537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:26:57.719593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:26:57.720620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 576/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:26:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:26:57.725620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b332dac-5155-4035-a42c-c5661fbf3ff6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:57.817628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b332dac-5155-4035-a42c-c5661fbf3ff6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:57.849169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:57.849840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:57.850119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:57.850388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:57.851117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:57.851419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:57.852767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:57.860393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 581/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:26:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:57.867902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edc29e-e61d-4632-b787-c202525fef80 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:57.961133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edc29e-e61d-4632-b787-c202525fef80 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:57.992331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661f43-b6e7-4162-983c-4bf7666222f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:57.993111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661f43-b6e7-4162-983c-4bf7666222f9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:57.993388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661f43-b6e7-4162-983c-4bf7666222f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:57.993684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661f43-b6e7-4162-983c-4bf7666222f9 None admin] PATH_INFO: `/v3/users/c720e25348794b9a914cc326b26a30cc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:57.994856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661f43-b6e7-4162-983c-4bf7666222f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c720e25348794b9a914cc326b26a30cc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:57.996274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661f43-b6e7-4162-983c-4bf7666222f9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:57.997904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 577/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:26:57 2022] GET /identity/v3/users/c720e25348794b9a914cc326b26a30cc => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:58.003740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:58.096472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd588e3-9f65-4ab6-93cc-4936590305ca None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:58.127513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5073a5-0868-48c8-986b-2f3b61635362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:58.128132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5073a5-0868-48c8-986b-2f3b61635362 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:58.128410 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5073a5-0868-48c8-986b-2f3b61635362 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:58.128676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5073a5-0868-48c8-986b-2f3b61635362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:58.191087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5073a5-0868-48c8-986b-2f3b61635362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:58.192520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5073a5-0868-48c8-986b-2f3b61635362 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:58.281832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 582/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:26:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:26:58.287637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661f43-b6e7-4162-983c-4bf7666222f9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:58.380562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661f43-b6e7-4162-983c-4bf7666222f9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:58.414025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747a628-f06a-4f0b-a3f5-78ddefa4707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:58.414866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a628-f06a-4f0b-a3f5-78ddefa4707a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:58.415145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a628-f06a-4f0b-a3f5-78ddefa4707a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:58.415414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a628-f06a-4f0b-a3f5-78ddefa4707a None admin] PATH_INFO: `/v3/projects/dab0ea8c304d4d5db3a3ccbb02f4b695` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:58.416580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747a628-f06a-4f0b-a3f5-78ddefa4707a None admin] RBAC: Authorizing `identity:get_project(project_id=dab0ea8c304d4d5db3a3ccbb02f4b695)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:58.418034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747a628-f06a-4f0b-a3f5-78ddefa4707a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:58.420909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 578/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:26:58 2022] GET /identity/v3/projects/dab0ea8c304d4d5db3a3ccbb02f4b695 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:26:58.426833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5073a5-0868-48c8-986b-2f3b61635362 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:26:58.517948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5073a5-0868-48c8-986b-2f3b61635362 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:26:58.549960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19264419-ede8-42a3-b483-0518b2ab980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:26:58.550542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19264419-ede8-42a3-b483-0518b2ab980c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:26:58.550822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19264419-ede8-42a3-b483-0518b2ab980c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:26:58.551094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19264419-ede8-42a3-b483-0518b2ab980c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:26:58.551904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19264419-ede8-42a3-b483-0518b2ab980c None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=dab0ea8c304d4d5db3a3ccbb02f4b695, user.id=c720e25348794b9a914cc326b26a30cc) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:26:58.552213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19264419-ede8-42a3-b483-0518b2ab980c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:26:58.553651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19264419-ede8-42a3-b483-0518b2ab980c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:26:58.559134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 583/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:26:58 2022] GET /identity/v3/role_assignments?user.id=c720e25348794b9a914cc326b26a30cc&scope.project.id=dab0ea8c304d4d5db3a3ccbb02f4b695&role.id=de114c58fdc8476ebab657e6f9359155 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:00.763572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ac672-9e6a-4d12-aafe-718fd3921981 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:00.764623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ac672-9e6a-4d12-aafe-718fd3921981 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:00.764623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ac672-9e6a-4d12-aafe-718fd3921981 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:00.766049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 579/1162] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:27:00.771162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282e48-d8f4-4431-b4c0-03fcda14429e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:00.771591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282e48-d8f4-4431-b4c0-03fcda14429e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:00.771719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1282e48-d8f4-4431-b4c0-03fcda14429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:00.787893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a1282e48-d8f4-4431-b4c0-03fcda14429e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:27:00.789055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a1282e48-d8f4-4431-b4c0-03fcda14429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:00.850579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 584/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:27:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:27:00.872571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ac672-9e6a-4d12-aafe-718fd3921981 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:00.965732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ac672-9e6a-4d12-aafe-718fd3921981 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:00.996635 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b3838-39b8-49b4-9a47-be47907680ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:00.997250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3838-39b8-49b4-9a47-be47907680ed None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:00.997529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3838-39b8-49b4-9a47-be47907680ed None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:00.997828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b3838-39b8-49b4-9a47-be47907680ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:01.058730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b3838-39b8-49b4-9a47-be47907680ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:01.060177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b3838-39b8-49b4-9a47-be47907680ed None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:01.149618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 580/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:27:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 07:27:01.155284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1282e48-d8f4-4431-b4c0-03fcda14429e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:01.251161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1282e48-d8f4-4431-b4c0-03fcda14429e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:01.282345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163aaeb-0198-47c5-9a84-806f227ec43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:01.283131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163aaeb-0198-47c5-9a84-806f227ec43e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:01.283409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163aaeb-0198-47c5-9a84-806f227ec43e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:01.283677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163aaeb-0198-47c5-9a84-806f227ec43e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:01.289994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163aaeb-0198-47c5-9a84-806f227ec43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:01.291424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163aaeb-0198-47c5-9a84-806f227ec43e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-7163aaeb-0198-47c5-9a84-806f227ec43e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:27:01.305780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:27:01.306977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:27:01.307820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 585/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:27:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:27:01.313312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b3838-39b8-49b4-9a47-be47907680ed None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:01.403846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b3838-39b8-49b4-9a47-be47907680ed None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:01.436452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db034-7a35-492d-8751-f53dad8b6eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:01.437093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db034-7a35-492d-8751-f53dad8b6eb2 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:01.437646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db034-7a35-492d-8751-f53dad8b6eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:01.437926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db034-7a35-492d-8751-f53dad8b6eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:01.438644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249db034-7a35-492d-8751-f53dad8b6eb2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:27:01.438952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249db034-7a35-492d-8751-f53dad8b6eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:01.440308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249db034-7a35-492d-8751-f53dad8b6eb2 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:01.447107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 581/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Wed May 11 07:27:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:27:03.639951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeda5e-6f13-4439-b535-c9479072157d None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:03.640463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeda5e-6f13-4439-b535-c9479072157d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:03.640557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deeda5e-6f13-4439-b535-c9479072157d None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:03.641890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 586/1167] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:27:03.647148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c428a3d-6644-4879-9c53-03d6c3a26cef None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:03.647524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c428a3d-6644-4879-9c53-03d6c3a26cef None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:03.647703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c428a3d-6644-4879-9c53-03d6c3a26cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:03.664373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3c428a3d-6644-4879-9c53-03d6c3a26cef None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:27:03.665554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3c428a3d-6644-4879-9c53-03d6c3a26cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:03.728735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 582/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:27:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:27:03.751329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deeda5e-6f13-4439-b535-c9479072157d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:03.848729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deeda5e-6f13-4439-b535-c9479072157d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:03.879401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478963e8-08bd-4375-b9bf-90557d0d9256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:03.880037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478963e8-08bd-4375-b9bf-90557d0d9256 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:03.880316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478963e8-08bd-4375-b9bf-90557d0d9256 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:03.880583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478963e8-08bd-4375-b9bf-90557d0d9256 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:03.881313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478963e8-08bd-4375-b9bf-90557d0d9256 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:03.882696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478963e8-08bd-4375-b9bf-90557d0d9256 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:03.896908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 587/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Wed May 11 07:27:03 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:27:06.131763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe69473-b509-4287-aa2f-c7df22654a51 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:06.132289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe69473-b509-4287-aa2f-c7df22654a51 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:06.132380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe69473-b509-4287-aa2f-c7df22654a51 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:06.133735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 583/1170] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:27:06.139050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4e070-080f-4678-963e-9b4543683a8a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:06.139414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4e070-080f-4678-963e-9b4543683a8a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:06.139606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4e070-080f-4678-963e-9b4543683a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:06.155583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d6f4e070-080f-4678-963e-9b4543683a8a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:27:06.156751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d6f4e070-080f-4678-963e-9b4543683a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:06.220928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 588/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:27:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:27:06.244146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe69473-b509-4287-aa2f-c7df22654a51 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:06.338237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe69473-b509-4287-aa2f-c7df22654a51 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:06.369591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416034b8-7ed8-486f-9930-a98f92cbfc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:06.370434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416034b8-7ed8-486f-9930-a98f92cbfc80 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:06.370715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416034b8-7ed8-486f-9930-a98f92cbfc80 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:06.370989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416034b8-7ed8-486f-9930-a98f92cbfc80 None admin] PATH_INFO: `/v3/domains/9c82fe28bae540ea917294fde343d43d` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:06.381343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416034b8-7ed8-486f-9930-a98f92cbfc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9c82fe28bae540ea917294fde343d43d)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:06.382878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416034b8-7ed8-486f-9930-a98f92cbfc80 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:06.384427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 584/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Wed May 11 07:27:06 2022] GET /identity/v3/domains/9c82fe28bae540ea917294fde343d43d => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:06.390120 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4e070-080f-4678-963e-9b4543683a8a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:06.485682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4e070-080f-4678-963e-9b4543683a8a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:06.516425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72947de-9896-4de7-9bf8-46f7fee110a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:06.517083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72947de-9896-4de7-9bf8-46f7fee110a3 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:06.517364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72947de-9896-4de7-9bf8-46f7fee110a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:06.517667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72947de-9896-4de7-9bf8-46f7fee110a3 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:06.518369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72947de-9896-4de7-9bf8-46f7fee110a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:06.519801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72947de-9896-4de7-9bf8-46f7fee110a3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:06.543543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 589/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:27:06 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:27:08.906091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cd09-e6dd-45a5-82f8-b5cffd6f152a None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:08.906631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cd09-e6dd-45a5-82f8-b5cffd6f152a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:08.906631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cd09-e6dd-45a5-82f8-b5cffd6f152a None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:08.907935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 585/1174] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:27:08.913222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dff0e-af9e-4cb6-a0c7-fd7da1be106d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:08.913674 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dff0e-af9e-4cb6-a0c7-fd7da1be106d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:08.913809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dff0e-af9e-4cb6-a0c7-fd7da1be106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:08.929807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e84dff0e-af9e-4cb6-a0c7-fd7da1be106d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:27:08.930974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e84dff0e-af9e-4cb6-a0c7-fd7da1be106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:09.005056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 590/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:27:09.029967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53cd09-e6dd-45a5-82f8-b5cffd6f152a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:09.125353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53cd09-e6dd-45a5-82f8-b5cffd6f152a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:09.155621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9abbad-fcc7-431c-bb4c-a36789306a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:09.156508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9abbad-fcc7-431c-bb4c-a36789306a9e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:09.156739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9abbad-fcc7-431c-bb4c-a36789306a9e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:09.157007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9abbad-fcc7-431c-bb4c-a36789306a9e None admin] PATH_INFO: `/v3/domains/9c82fe28bae540ea917294fde343d43d` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:09.158322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9abbad-fcc7-431c-bb4c-a36789306a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=9c82fe28bae540ea917294fde343d43d)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:09.159728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9abbad-fcc7-431c-bb4c-a36789306a9e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:09.161312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 586/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Wed May 11 07:27:09 2022] GET /identity/v3/domains/9c82fe28bae540ea917294fde343d43d => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:09.167302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dff0e-af9e-4cb6-a0c7-fd7da1be106d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:09.258968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dff0e-af9e-4cb6-a0c7-fd7da1be106d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:09.289921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a7906-8a7f-4a78-b218-00ae28eb5c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:09.290580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7906-8a7f-4a78-b218-00ae28eb5c0c None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:09.290865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7906-8a7f-4a78-b218-00ae28eb5c0c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:09.291147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7906-8a7f-4a78-b218-00ae28eb5c0c None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:09.291859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a7906-8a7f-4a78-b218-00ae28eb5c0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:09.293284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a7906-8a7f-4a78-b218-00ae28eb5c0c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:09.314008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 591/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:27:09 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:27:11.552935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ad0ae-0765-4fd0-98a0-982bc07926e5 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:11.553437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ad0ae-0765-4fd0-98a0-982bc07926e5 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:11.553573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ad0ae-0765-4fd0-98a0-982bc07926e5 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:11.554877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 587/1178] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:27:11.559955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12896af-be9d-4b6d-8638-fa8fc68e2049 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:11.560397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12896af-be9d-4b6d-8638-fa8fc68e2049 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:11.560517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12896af-be9d-4b6d-8638-fa8fc68e2049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:11.577438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b12896af-be9d-4b6d-8638-fa8fc68e2049 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:27:11.578642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b12896af-be9d-4b6d-8638-fa8fc68e2049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:11.640064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 592/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:27:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:27:11.663455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ad0ae-0765-4fd0-98a0-982bc07926e5 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:11.757857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ad0ae-0765-4fd0-98a0-982bc07926e5 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:11.788691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299825b-39d5-43bc-8d62-004842c42216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:11.789459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299825b-39d5-43bc-8d62-004842c42216 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:11.789769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299825b-39d5-43bc-8d62-004842c42216 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:11.790045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299825b-39d5-43bc-8d62-004842c42216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:11.799947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299825b-39d5-43bc-8d62-004842c42216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e299825b-39d5-43bc-8d62-004842c42216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:27:11.807552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:27:11.808726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:27:11.809726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 588/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:27:11.815246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12896af-be9d-4b6d-8638-fa8fc68e2049 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:11.907473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12896af-be9d-4b6d-8638-fa8fc68e2049 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:11.939148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:11.939800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:11.940081 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:11.940355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:11.941161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:27:11.941161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:11.942767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:11.950732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 593/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:27:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:11.957071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299825b-39d5-43bc-8d62-004842c42216 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:12.050875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299825b-39d5-43bc-8d62-004842c42216 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:12.083903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4f93-20eb-4fb5-b14e-93b8ad072ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:12.084772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4f93-20eb-4fb5-b14e-93b8ad072ef7 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:12.085054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4f93-20eb-4fb5-b14e-93b8ad072ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:12.085327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d4f93-20eb-4fb5-b14e-93b8ad072ef7 None admin] PATH_INFO: `/v3/users/6f157f2e9544433c9573e06912ec1f20` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:12.097977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d4f93-20eb-4fb5-b14e-93b8ad072ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=6f157f2e9544433c9573e06912ec1f20)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:12.099427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d4f93-20eb-4fb5-b14e-93b8ad072ef7 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:12.101441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 589/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:27:11 2022] GET /identity/v3/users/6f157f2e9544433c9573e06912ec1f20 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:12.107538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:12.201915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566888a-8b32-4894-8c46-7aaabf35335e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:12.232566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b61e4-223a-4836-9f92-fd86c662552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:12.233196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b61e4-223a-4836-9f92-fd86c662552f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:12.233477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b61e4-223a-4836-9f92-fd86c662552f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:12.233775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b61e4-223a-4836-9f92-fd86c662552f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:12.295422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b61e4-223a-4836-9f92-fd86c662552f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:12.296887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b61e4-223a-4836-9f92-fd86c662552f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:12.386767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 594/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:27:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:27:12.392522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4f93-20eb-4fb5-b14e-93b8ad072ef7 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:12.488654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d4f93-20eb-4fb5-b14e-93b8ad072ef7 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:12.520895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a92dd6-7d8f-45e0-b29a-d9fb125bd00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:12.521760 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92dd6-7d8f-45e0-b29a-d9fb125bd00b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:12.522046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92dd6-7d8f-45e0-b29a-d9fb125bd00b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:12.522320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92dd6-7d8f-45e0-b29a-d9fb125bd00b None admin] PATH_INFO: `/v3/projects/0dd136f0e4a9453aadfebb94c6d866c2` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:12.523481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a92dd6-7d8f-45e0-b29a-d9fb125bd00b None admin] RBAC: Authorizing `identity:get_project(project_id=0dd136f0e4a9453aadfebb94c6d866c2)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:12.524899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a92dd6-7d8f-45e0-b29a-d9fb125bd00b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:12.526602 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 590/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:27:12 2022] GET /identity/v3/projects/0dd136f0e4a9453aadfebb94c6d866c2 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:12.533081 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b61e4-223a-4836-9f92-fd86c662552f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:12.624439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b61e4-223a-4836-9f92-fd86c662552f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:12.655663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d40a0-8426-46ef-aa87-b5227dda8a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:12.656248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d40a0-8426-46ef-aa87-b5227dda8a33 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:12.656530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d40a0-8426-46ef-aa87-b5227dda8a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:12.656804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d40a0-8426-46ef-aa87-b5227dda8a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:12.657642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d40a0-8426-46ef-aa87-b5227dda8a33 None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=0dd136f0e4a9453aadfebb94c6d866c2, user.id=6f157f2e9544433c9573e06912ec1f20) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:27:12.657955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d40a0-8426-46ef-aa87-b5227dda8a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:12.659365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d40a0-8426-46ef-aa87-b5227dda8a33 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:12.664513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 595/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:27:12 2022] GET /identity/v3/role_assignments?user.id=6f157f2e9544433c9573e06912ec1f20&scope.project.id=0dd136f0e4a9453aadfebb94c6d866c2&role.id=de114c58fdc8476ebab657e6f9359155 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:14.838505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77993917-bf16-4a03-8195-0adfbd7185b6 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:14.839001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77993917-bf16-4a03-8195-0adfbd7185b6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:14.839001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77993917-bf16-4a03-8195-0adfbd7185b6 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:14.840336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 591/1186] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:27:14.845494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45bc61-b0da-43cb-bf9a-2b7170c4752b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:14.845901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45bc61-b0da-43cb-bf9a-2b7170c4752b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:14.846076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45bc61-b0da-43cb-bf9a-2b7170c4752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:14.862453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-7a45bc61-b0da-43cb-bf9a-2b7170c4752b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:27:14.863616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7a45bc61-b0da-43cb-bf9a-2b7170c4752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:14.925181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 596/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:27:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:27:14.948231 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77993917-bf16-4a03-8195-0adfbd7185b6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:15.042947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77993917-bf16-4a03-8195-0adfbd7185b6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:15.074490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492111c-c93e-48ad-8861-c00ff72f333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:15.075257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492111c-c93e-48ad-8861-c00ff72f333c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:15.075538 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492111c-c93e-48ad-8861-c00ff72f333c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:15.076357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492111c-c93e-48ad-8861-c00ff72f333c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:15.085848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492111c-c93e-48ad-8861-c00ff72f333c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-e492111c-c93e-48ad-8861-c00ff72f333c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:27:15.093522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:27:15.094681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:27:15.095583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 592/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:27:15.100318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45bc61-b0da-43cb-bf9a-2b7170c4752b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:15.192588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45bc61-b0da-43cb-bf9a-2b7170c4752b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:15.223535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:15.224180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:15.224463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:15.224739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:15.225468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:27:15.225805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:15.227157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:15.235192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 597/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:27:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:15.240684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492111c-c93e-48ad-8861-c00ff72f333c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:15.333828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492111c-c93e-48ad-8861-c00ff72f333c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:15.364719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6ecf-f5b5-4cc1-adcb-363946666187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:15.365505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6ecf-f5b5-4cc1-adcb-363946666187 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:15.365810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6ecf-f5b5-4cc1-adcb-363946666187 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:15.366083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef6ecf-f5b5-4cc1-adcb-363946666187 None admin] PATH_INFO: `/v3/users/6f157f2e9544433c9573e06912ec1f20` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:15.367246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef6ecf-f5b5-4cc1-adcb-363946666187 None admin] RBAC: Authorizing `identity:get_user(user_id=6f157f2e9544433c9573e06912ec1f20)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:15.368658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef6ecf-f5b5-4cc1-adcb-363946666187 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:15.370291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 593/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:27:15 2022] GET /identity/v3/users/6f157f2e9544433c9573e06912ec1f20 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:15.376422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:15.469352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fcae4-2ac3-438a-aec0-c020e0c230f5 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:15.500503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1844aa9-d950-47f3-ae66-8cd6867d0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:15.501359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844aa9-d950-47f3-ae66-8cd6867d0595 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:15.501672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844aa9-d950-47f3-ae66-8cd6867d0595 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:15.501948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844aa9-d950-47f3-ae66-8cd6867d0595 None admin] PATH_INFO: `/v3/projects/0dd136f0e4a9453aadfebb94c6d866c2` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:15.503108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1844aa9-d950-47f3-ae66-8cd6867d0595 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd136f0e4a9453aadfebb94c6d866c2)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:15.504529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1844aa9-d950-47f3-ae66-8cd6867d0595 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:15.506331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 598/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:27:15 2022] GET /identity/v3/projects/0dd136f0e4a9453aadfebb94c6d866c2 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:15.512119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6ecf-f5b5-4cc1-adcb-363946666187 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:15.603896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef6ecf-f5b5-4cc1-adcb-363946666187 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:15.634696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517c0db-bbad-450d-b644-d42aa6b27ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:15.635501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517c0db-bbad-450d-b644-d42aa6b27ad0 None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:15.635777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517c0db-bbad-450d-b644-d42aa6b27ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:15.636047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517c0db-bbad-450d-b644-d42aa6b27ad0 None admin] PATH_INFO: `/v3/projects/0dd136f0e4a9453aadfebb94c6d866c2/users/6f157f2e9544433c9573e06912ec1f20/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:15.637976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517c0db-bbad-450d-b644-d42aa6b27ad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0dd136f0e4a9453aadfebb94c6d866c2, user_id=6f157f2e9544433c9573e06912ec1f20, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:15.639406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517c0db-bbad-450d-b644-d42aa6b27ad0 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:15.651377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 594/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:27:15 2022] PUT /identity/v3/projects/0dd136f0e4a9453aadfebb94c6d866c2/users/6f157f2e9544433c9573e06912ec1f20/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:27:17.827132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9cb35-0511-465c-bf87-42c3a1284fb1 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:17.827636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9cb35-0511-465c-bf87-42c3a1284fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:17.827636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9cb35-0511-465c-bf87-42c3a1284fb1 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:17.829059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 599/1193] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:27:17.834346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80e60-bc72-4032-8ea2-1d636bb11316 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:17.834710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80e60-bc72-4032-8ea2-1d636bb11316 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:17.834908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80e60-bc72-4032-8ea2-1d636bb11316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:17.851604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2aa80e60-bc72-4032-8ea2-1d636bb11316 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:27:17.852771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2aa80e60-bc72-4032-8ea2-1d636bb11316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:27:17.914927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 595/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:27:17.938057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9cb35-0511-465c-bf87-42c3a1284fb1 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:18.032776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9cb35-0511-465c-bf87-42c3a1284fb1 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:18.063908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac54fc8-1525-4906-81c2-bdd2d557de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:18.064672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54fc8-1525-4906-81c2-bdd2d557de9e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:18.064954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54fc8-1525-4906-81c2-bdd2d557de9e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:18.065228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54fc8-1525-4906-81c2-bdd2d557de9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:18.074631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac54fc8-1525-4906-81c2-bdd2d557de9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-aac54fc8-1525-4906-81c2-bdd2d557de9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:27:18.082874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:27:18.083951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:27:18.085073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 600/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:27:18.089929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa80e60-bc72-4032-8ea2-1d636bb11316 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:18.181737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa80e60-bc72-4032-8ea2-1d636bb11316 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:18.214140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:18.214793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:18.215076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:18.215353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:18.216096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:27:18.216400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:18.217768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:18.225335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 596/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:18.230635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac54fc8-1525-4906-81c2-bdd2d557de9e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:18.323491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac54fc8-1525-4906-81c2-bdd2d557de9e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:18.354334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3789-963b-4f60-928b-13c2f28cec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:18.355120 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3789-963b-4f60-928b-13c2f28cec1a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:18.355396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3789-963b-4f60-928b-13c2f28cec1a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:18.355664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de3789-963b-4f60-928b-13c2f28cec1a None admin] PATH_INFO: `/v3/users/6f157f2e9544433c9573e06912ec1f20` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:18.356858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de3789-963b-4f60-928b-13c2f28cec1a None admin] RBAC: Authorizing `identity:get_user(user_id=6f157f2e9544433c9573e06912ec1f20)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:18.358301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de3789-963b-4f60-928b-13c2f28cec1a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:18.359871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 601/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Wed May 11 07:27:18 2022] GET /identity/v3/users/6f157f2e9544433c9573e06912ec1f20 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:18.365357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:18.461269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec21b11-53b6-4987-9a93-9cc4717abb6c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:18.492838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2d39-ee84-4b86-b0ce-0c26f738d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:18.493478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2d39-ee84-4b86-b0ce-0c26f738d8fe None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:18.493906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2d39-ee84-4b86-b0ce-0c26f738d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:18.494179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2d39-ee84-4b86-b0ce-0c26f738d8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:18.556053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d2d39-ee84-4b86-b0ce-0c26f738d8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:18.557472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d2d39-ee84-4b86-b0ce-0c26f738d8fe None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:18.648066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 597/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:27:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:27:18.653900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3789-963b-4f60-928b-13c2f28cec1a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:18.746218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de3789-963b-4f60-928b-13c2f28cec1a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:18.776971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd679e-b5c5-41af-9343-2acc8f879a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:18.777842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd679e-b5c5-41af-9343-2acc8f879a35 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:18.778124 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd679e-b5c5-41af-9343-2acc8f879a35 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:18.778397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd679e-b5c5-41af-9343-2acc8f879a35 None admin] PATH_INFO: `/v3/projects/0dd136f0e4a9453aadfebb94c6d866c2` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:18.779583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd679e-b5c5-41af-9343-2acc8f879a35 None admin] RBAC: Authorizing `identity:get_project(project_id=0dd136f0e4a9453aadfebb94c6d866c2)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:18.780998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd679e-b5c5-41af-9343-2acc8f879a35 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:18.782686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 602/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Wed May 11 07:27:18 2022] GET /identity/v3/projects/0dd136f0e4a9453aadfebb94c6d866c2 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:27:18.788647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2d39-ee84-4b86-b0ce-0c26f738d8fe None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:27:18.880464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2d39-ee84-4b86-b0ce-0c26f738d8fe None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:27:18.912124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec5b44-f55f-4c39-8c65-8f44b42b530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:27:18.912757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5b44-f55f-4c39-8c65-8f44b42b530c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:27:18.913036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5b44-f55f-4c39-8c65-8f44b42b530c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:27:18.913307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5b44-f55f-4c39-8c65-8f44b42b530c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:27:18.914148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec5b44-f55f-4c39-8c65-8f44b42b530c None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=0dd136f0e4a9453aadfebb94c6d866c2, user.id=6f157f2e9544433c9573e06912ec1f20) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:27:18.914456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec5b44-f55f-4c39-8c65-8f44b42b530c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:27:18.915863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec5b44-f55f-4c39-8c65-8f44b42b530c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:27:18.921964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 598/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:27:18 2022] GET /identity/v3/role_assignments?user.id=6f157f2e9544433c9573e06912ec1f20&scope.project.id=0dd136f0e4a9453aadfebb94c6d866c2&role.id=de114c58fdc8476ebab657e6f9359155 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:19.209492 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704a410-f622-428e-a1df-87fe735b5e7e None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:19.210151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704a410-f622-428e-a1df-87fe735b5e7e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:19.210255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704a410-f622-428e-a1df-87fe735b5e7e None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:19.212262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 603/1201] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:28:19.219980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a821f6d-6f35-4fba-b96f-5215bfed76c1 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:19.220558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a821f6d-6f35-4fba-b96f-5215bfed76c1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:19.220558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a821f6d-6f35-4fba-b96f-5215bfed76c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:19.241765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0a821f6d-6f35-4fba-b96f-5215bfed76c1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:19.243010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0a821f6d-6f35-4fba-b96f-5215bfed76c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:19.329869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 599/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:19.347731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704a410-f622-428e-a1df-87fe735b5e7e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:19.477083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704a410-f622-428e-a1df-87fe735b5e7e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:19.518739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:19.520121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:19.520619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:19.521199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:19.534037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:19.535632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:19.559689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:19.561079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:19.562827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:19.562827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:19.562827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:19.562827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:19.569157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 604/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:19.570261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a821f6d-6f35-4fba-b96f-5215bfed76c1 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:19.692876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a821f6d-6f35-4fba-b96f-5215bfed76c1 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:19.732093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926607dc-36bb-4bcb-932b-adf0b6e47945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:19.732757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926607dc-36bb-4bcb-932b-adf0b6e47945 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:19.733742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926607dc-36bb-4bcb-932b-adf0b6e47945 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:19.734215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926607dc-36bb-4bcb-932b-adf0b6e47945 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:19.734996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926607dc-36bb-4bcb-932b-adf0b6e47945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:19.735317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926607dc-36bb-4bcb-932b-adf0b6e47945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:19.736696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926607dc-36bb-4bcb-932b-adf0b6e47945 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:19.749812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 600/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:28:19.755302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:19.876530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d258a-7403-43ea-8b45-37ae8ad9c4ed None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:19.927191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaed08-83c0-43fb-bf61-2a1eae31a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:19.927957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaed08-83c0-43fb-bf61-2a1eae31a63a None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:19.928258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaed08-83c0-43fb-bf61-2a1eae31a63a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:19.928511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaed08-83c0-43fb-bf61-2a1eae31a63a None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:19.929348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaed08-83c0-43fb-bf61-2a1eae31a63a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:19.930918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaed08-83c0-43fb-bf61-2a1eae31a63a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:19.960847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 605/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Wed May 11 07:28:19 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:28:22.446713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e15b-7c0e-4348-ab3d-41bc41508811 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:22.447307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e15b-7c0e-4348-ab3d-41bc41508811 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:22.447307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e15b-7c0e-4348-ab3d-41bc41508811 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:22.449196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 601/1206] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:22.455414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee493-4fe1-4a9f-b046-7d68ee90c156 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:22.455862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee493-4fe1-4a9f-b046-7d68ee90c156 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:22.456201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee493-4fe1-4a9f-b046-7d68ee90c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:22.473967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-93aee493-4fe1-4a9f-b046-7d68ee90c156 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:22.475394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-93aee493-4fe1-4a9f-b046-7d68ee90c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:22.546908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 606/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:22.576265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e15b-7c0e-4348-ab3d-41bc41508811 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:22.693368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e15b-7c0e-4348-ab3d-41bc41508811 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:22.733265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ff94-5ad7-4bff-bf45-72877d3c2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:22.734418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ff94-5ad7-4bff-bf45-72877d3c2f49 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:22.734905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ff94-5ad7-4bff-bf45-72877d3c2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:22.735292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412ff94-5ad7-4bff-bf45-72877d3c2f49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:22.747255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412ff94-5ad7-4bff-bf45-72877d3c2f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-b412ff94-5ad7-4bff-bf45-72877d3c2f49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:28:22.755074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:22.757664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:22.758553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 602/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:28:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:22.762763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee493-4fe1-4a9f-b046-7d68ee90c156 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:22.865965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aee493-4fe1-4a9f-b046-7d68ee90c156 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:22.904382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:22.905153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:22.905458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:22.905757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:22.906557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:22.906876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:22.908475 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:22.917666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 607/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:28:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:22.923353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ff94-5ad7-4bff-bf45-72877d3c2f49 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:23.031956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412ff94-5ad7-4bff-bf45-72877d3c2f49 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:23.072257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:23.073699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:23.074025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:23.074475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:23.086353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:23.087848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:23.106333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:23.112933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:23.113926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:23.113926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:23.113926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:23.113926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:23.113926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 603/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:23.114233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:23.217035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5def90-5b23-453b-94af-cd797c7bf9a2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:23.255786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:23.257845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:23.257845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:23.257845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:23.257845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:23.258173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:23.259346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:23.272275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 608/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:23.279221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:23.405282 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d287e90-b159-4a6d-a766-40207bee369f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:23.444114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:23.444959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:23.445243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:23.445534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:23.454948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:23.456446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:28:23.472148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:23.473201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:23.474201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 604/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:28:23.479146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:23.597703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac01d47-fda6-497c-af30-f8f8c6d12353 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:23.634174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:23.635098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:23.635963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:23.636254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:23.637404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:23.637793 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:23.639387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:23.660283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 609/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Wed May 11 07:28:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:28:23.665916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:23.784614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4b24e-6f2e-4c7f-9623-1246102069d4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:23.825669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8f03-75f0-457c-a22b-3bbf912ff17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:23.826356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f03-75f0-457c-a22b-3bbf912ff17c None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:23.826781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f03-75f0-457c-a22b-3bbf912ff17c None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:23.827085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f03-75f0-457c-a22b-3bbf912ff17c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:23.905679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a8f03-75f0-457c-a22b-3bbf912ff17c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:23.907422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a8f03-75f0-457c-a22b-3bbf912ff17c None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:24.026742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 605/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:28:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:28:24.032227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:24.140462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1329e9-55d8-4c97-a79e-8c2392c6a8fe None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:24.176434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:24.177676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:24.177676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:24.177676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:24.188655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:24.190387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:24.212161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:24.213310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:24.214970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:24.214970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:24.214970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:24.214970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:24.217692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 610/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:28:24.219721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8f03-75f0-457c-a22b-3bbf912ff17c None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:24.331663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8f03-75f0-457c-a22b-3bbf912ff17c None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:24.366850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:24.367661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:24.368062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:24.368433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:24.369246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:24.369741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:24.371340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:24.385765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 606/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:24.391269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:24.496272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f9470-2a10-4be5-a1dc-5ff5764f865a None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:24.531754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:24.532546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:24.532822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:24.533092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:24.539947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:24.541397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:28:24.555361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:24.556473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:24.557832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 611/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:24.562754 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:24.669368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b520f0-2618-4219-8317-41e03da7daa9 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:24.708050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a74286-3bff-4abe-bec3-0ac0b018bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:24.708780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74286-3bff-4abe-bec3-0ac0b018bc9a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:24.709060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74286-3bff-4abe-bec3-0ac0b018bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:24.709334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a74286-3bff-4abe-bec3-0ac0b018bc9a None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:24.710150 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a74286-3bff-4abe-bec3-0ac0b018bc9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:24.710459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a74286-3bff-4abe-bec3-0ac0b018bc9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:24.711881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a74286-3bff-4abe-bec3-0ac0b018bc9a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:24.730681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 607/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:24.731964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:24.835238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59873616-6832-4e4f-8487-735a3cbb4e3f None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:24.871815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e44cd6-5e2f-4faa-908a-e2fd63f46ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:24.872605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44cd6-5e2f-4faa-908a-e2fd63f46ffc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:24.873168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44cd6-5e2f-4faa-908a-e2fd63f46ffc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:24.873630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e44cd6-5e2f-4faa-908a-e2fd63f46ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:24.874667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44cd6-5e2f-4faa-908a-e2fd63f46ffc None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=a1b36840995045199ec96eac939d5d35) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:24.875291 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44cd6-5e2f-4faa-908a-e2fd63f46ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:24.877454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e44cd6-5e2f-4faa-908a-e2fd63f46ffc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:24.893590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 612/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:28:24 2022] GET /identity/v3/role_assignments?user.id=a1b36840995045199ec96eac939d5d35&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:27.224417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b24c-5035-4fd9-a767-7915b369d68f None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:27.224973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b24c-5035-4fd9-a767-7915b369d68f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:27.224973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6b24c-5035-4fd9-a767-7915b369d68f None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:27.226568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 608/1220] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:27.233306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289e72-1889-4aab-944d-cab649471777 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:27.233817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289e72-1889-4aab-944d-cab649471777 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:27.233909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289e72-1889-4aab-944d-cab649471777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:27.252380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ad289e72-1889-4aab-944d-cab649471777 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:27.254079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ad289e72-1889-4aab-944d-cab649471777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:27.331517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 613/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:27.357890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6b24c-5035-4fd9-a767-7915b369d68f None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:27.474666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6b24c-5035-4fd9-a767-7915b369d68f None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:27.513596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41053df2-f6ca-40df-8325-20cda8f53ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:27.514681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053df2-f6ca-40df-8325-20cda8f53ad4 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:27.515054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053df2-f6ca-40df-8325-20cda8f53ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:27.515418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053df2-f6ca-40df-8325-20cda8f53ad4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:27.528519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41053df2-f6ca-40df-8325-20cda8f53ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-41053df2-f6ca-40df-8325-20cda8f53ad4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:28:27.537434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:27.538461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:27.539293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 609/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:27.547049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad289e72-1889-4aab-944d-cab649471777 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:27.659325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad289e72-1889-4aab-944d-cab649471777 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:27.695335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:27.696063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:27.696356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:27.696648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:27.697424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] RBAC: Adding query filter params (name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:27.698316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:27.699697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:27.708043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 614/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:28:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:27.714367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41053df2-f6ca-40df-8325-20cda8f53ad4 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:27.827838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41053df2-f6ca-40df-8325-20cda8f53ad4 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:27.867312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:27.868501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:27.868987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:27.869487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:27.881662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:27.883598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:27.904663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:27.905899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:27.906807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:27.906807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:27.906807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:27.906807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:27.907026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 610/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:28:27.913402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:28.012761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efdcba-09b3-4a86-a6db-b6790d623ddf None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:28.048176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:28.048852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:28.049161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:28.049473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:28.050286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:28.050622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:28.052052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:28.064969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 615/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:28.071163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:28.169705 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b566-4778-4cc1-8553-0487baa25e9e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:28.203883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:28.204706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:28.204995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:28.205264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:28.213940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:28.215366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:28:28.230141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:28.231723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:28.232670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 611/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:28.237848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:28.340982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c538c-7cac-4878-8837-eb7c0974a0d7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:28.375357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:28.376206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:28.376558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:28.376925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:28.377882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:28.378304 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:28.379940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:28.397755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 616/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Wed May 11 07:28:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:28.404397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:28.512240 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47da60-822f-4c88-a540-6536d85fd70d None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:28.548756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:28.549551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:28.549845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:28.550125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:28.560758 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:28.562491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:28.580385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:28.581677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:28.582980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:28.582980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:28.582980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:28.582980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:28.582980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 612/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:28.587633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:28.693885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaadfa9-7ab1-471c-a451-acae9382a94e None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:28.729462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:28.730210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:28.730532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:28.730848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:28.731620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:28.731953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:28.733423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:28.745989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 617/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:28.752226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:28.860771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa838ab-c72c-4ab6-8afb-848cb0179e11 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:28.896479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:28.897366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:28.897742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:28.898081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:28.906364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:28.907820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:28:28.925040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:28.926044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:28.926951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 613/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:28.932725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:29.034187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7403-bd04-454c-8d93-10d1bff4f574 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:29.067370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72193ee-68a6-4d8a-82fc-d26901ab74a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:29.068018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72193ee-68a6-4d8a-82fc-d26901ab74a3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:29.068295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72193ee-68a6-4d8a-82fc-d26901ab74a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:29.068564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72193ee-68a6-4d8a-82fc-d26901ab74a3 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:29.069338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72193ee-68a6-4d8a-82fc-d26901ab74a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:29.069677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72193ee-68a6-4d8a-82fc-d26901ab74a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:29.071116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72193ee-68a6-4d8a-82fc-d26901ab74a3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:29.084060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 618/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:29.090678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:29.195423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102801de-bdce-4fbc-bd71-813b08421609 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:29.230868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df690307-755e-4843-8069-f0978631cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:29.231770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df690307-755e-4843-8069-f0978631cfdc None admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:29.232051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df690307-755e-4843-8069-f0978631cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:29.232342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df690307-755e-4843-8069-f0978631cfdc None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/a1b36840995045199ec96eac939d5d35/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:29.247890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df690307-755e-4843-8069-f0978631cfdc None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=a1b36840995045199ec96eac939d5d35, role_id=e09b4b74a6aa4b7a9dc344a03e5c9c35)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:29.249257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df690307-755e-4843-8069-f0978631cfdc None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:29.261624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 614/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:28:29 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/a1b36840995045199ec96eac939d5d35/roles/e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:28:31.549711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd460f3-f788-4580-a323-77bb804f3146 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:31.550293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd460f3-f788-4580-a323-77bb804f3146 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:31.550293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd460f3-f788-4580-a323-77bb804f3146 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:31.551787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 619/1233] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:31.557648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a39295-0beb-4541-975e-d9cdd9179233 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:31.558073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a39295-0beb-4541-975e-d9cdd9179233 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:31.558212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a39295-0beb-4541-975e-d9cdd9179233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:31.575772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-78a39295-0beb-4541-975e-d9cdd9179233 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:31.577044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-78a39295-0beb-4541-975e-d9cdd9179233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:31.653613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 615/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:31.671190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd460f3-f788-4580-a323-77bb804f3146 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:31.781633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd460f3-f788-4580-a323-77bb804f3146 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:31.818276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b901-7038-4640-b872-40cf2cb68405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:31.819052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b901-7038-4640-b872-40cf2cb68405 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:31.819331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b901-7038-4640-b872-40cf2cb68405 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:31.819599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b901-7038-4640-b872-40cf2cb68405 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:31.829879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b901-7038-4640-b872-40cf2cb68405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-6dc5b901-7038-4640-b872-40cf2cb68405 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:28:31.838484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:31.839634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:31.840669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 620/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Wed May 11 07:28:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:31.845744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a39295-0beb-4541-975e-d9cdd9179233 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:31.957821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a39295-0beb-4541-975e-d9cdd9179233 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:31.991172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:31.991852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:31.992137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:31.992412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:31.993167 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] RBAC: Adding query filter params (name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:31.993478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:31.995455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:32.005093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 616/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Wed May 11 07:28:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:32.010956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b901-7038-4640-b872-40cf2cb68405 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:32.113952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b901-7038-4640-b872-40cf2cb68405 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:32.154587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:32.155389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:32.155658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:32.155920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:32.167180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:32.168634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:32.186421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:32.188017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:32.189441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:32.189441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:32.189441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:32.189441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:32.189441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 621/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:32.194310 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:32.299226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c358119-d468-4695-8a9d-52500eb7769a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:32.336508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:32.337159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:32.337464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:32.337791 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:32.339083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:32.339418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:32.340959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:32.353167 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 617/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:32.360498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:32.462827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e2163-1341-4ed9-982c-886ddaf0a782 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:32.499354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:32.500240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:32.500591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:32.500936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:32.508143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:32.509732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:28:32.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:32.527721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:32.529085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 622/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:32.533706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:32.639408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b39a7-d2cd-4eca-9a8b-16cf92725792 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:32.674395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:32.675147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:32.675450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:32.675750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:32.676665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:32.677037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:32.678698 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:32.698891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 618/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Wed May 11 07:28:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:32.704741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:32.809010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca62be7-55b2-47db-abd7-202367201d16 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:32.843698 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772e78-355b-49ba-83de-d765dda54a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:32.844460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772e78-355b-49ba-83de-d765dda54a19 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:32.844728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772e78-355b-49ba-83de-d765dda54a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:32.845002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772e78-355b-49ba-83de-d765dda54a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:32.922997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f772e78-355b-49ba-83de-d765dda54a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:32.924627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f772e78-355b-49ba-83de-d765dda54a19 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:33.028222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 623/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:28:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:28:33.034744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:33.140854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399981a-19cd-4cfd-b5dc-7361d804e938 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:33.180453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:33.181331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:33.181641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:33.181917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:33.192604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:33.194311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:33.212597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:33.214337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:33.215372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:33.215372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:33.215372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:33.215372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:33.215372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 619/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:28:33.220292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772e78-355b-49ba-83de-d765dda54a19 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:33.322501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f772e78-355b-49ba-83de-d765dda54a19 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:33.359884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:33.360556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:33.360835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:33.361106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:33.361855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:33.362159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:33.363522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:33.374812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 624/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:33.381843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:33.493693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ddc5f-72f8-4dce-a2f8-90f740d94b35 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:33.526602 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:33.527388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:33.527667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:33.527937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:33.534601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:33.536488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:28:33.553451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:33.554600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:33.555690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 620/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:28:33.562073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:33.667072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f220e5-dea3-4509-a206-e83dc1767e66 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:33.700931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890f00-0e9e-439b-8bb1-0859a49ca4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:33.701714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890f00-0e9e-439b-8bb1-0859a49ca4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:33.702107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890f00-0e9e-439b-8bb1-0859a49ca4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:33.702375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890f00-0e9e-439b-8bb1-0859a49ca4c3 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:33.703115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890f00-0e9e-439b-8bb1-0859a49ca4c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:33.703419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890f00-0e9e-439b-8bb1-0859a49ca4c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:33.704842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890f00-0e9e-439b-8bb1-0859a49ca4c3 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:33.716576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 625/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:33.722661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:33.834395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce41b-5bea-4937-9cf4-6032cd82f3cf None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:33.878760 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98f4c7-b502-493c-a019-213f858ab3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:33.879516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f4c7-b502-493c-a019-213f858ab3bd None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:33.879843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f4c7-b502-493c-a019-213f858ab3bd None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:33.880221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98f4c7-b502-493c-a019-213f858ab3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:33.881135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98f4c7-b502-493c-a019-213f858ab3bd None admin] RBAC: Adding query filter params (role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=a1b36840995045199ec96eac939d5d35) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:33.881572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98f4c7-b502-493c-a019-213f858ab3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:33.883073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98f4c7-b502-493c-a019-213f858ab3bd None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:33.890052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 621/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:28:33 2022] GET /identity/v3/role_assignments?user.id=a1b36840995045199ec96eac939d5d35&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=e09b4b74a6aa4b7a9dc344a03e5c9c35 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:36.302879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff08ac-f696-4060-a13c-a13c3a50880f None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:36.303444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff08ac-f696-4060-a13c-a13c3a50880f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:36.303694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff08ac-f696-4060-a13c-a13c3a50880f None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:36.305664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 626/1247] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:36.310981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e0222-eef5-425d-93ee-bcf113860b3a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:36.311381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e0222-eef5-425d-93ee-bcf113860b3a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:36.311539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e0222-eef5-425d-93ee-bcf113860b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:36.329844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7b6e0222-eef5-425d-93ee-bcf113860b3a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:36.331388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7b6e0222-eef5-425d-93ee-bcf113860b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:36.405125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 622/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:36.429568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff08ac-f696-4060-a13c-a13c3a50880f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:36.550297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff08ac-f696-4060-a13c-a13c3a50880f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:36.588596 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12b25-fc48-4cb7-9110-df474473213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:36.589324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12b25-fc48-4cb7-9110-df474473213b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:36.589635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12b25-fc48-4cb7-9110-df474473213b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:36.589914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12b25-fc48-4cb7-9110-df474473213b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:36.600482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf12b25-fc48-4cb7-9110-df474473213b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-eaf12b25-fc48-4cb7-9110-df474473213b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:28:36.608325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:36.609610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:28:36.610657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:36.614761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 627/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:28:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:36.615711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e0222-eef5-425d-93ee-bcf113860b3a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:36.721148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e0222-eef5-425d-93ee-bcf113860b3a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:36.758933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:36.759629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:36.760478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:36.760748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:36.761494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:36.761828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:36.763198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:36.771277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 623/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:28:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:28:36.777840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12b25-fc48-4cb7-9110-df474473213b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:36.892919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf12b25-fc48-4cb7-9110-df474473213b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:36.932167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:36.933099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:36.933383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:36.933773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:36.945313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:36.946970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:36.968337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:36.970342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:36.972448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:36.972448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:36.972448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:36.972448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:36.972448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 628/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:36.976520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:37.084633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c023c0-8029-48a8-9365-69e9988d0249 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:37.120226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:37.120902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:37.121190 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:37.121550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:37.122284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:37.122647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:37.124173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:37.137485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 624/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:37.144341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:37.253217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a41a1-9e42-48aa-aa94-beacda152ee2 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:37.284301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:37.285102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:37.285435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:37.285683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:37.294253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:37.295831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:28:37.310979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:37.312909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:37.314271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 629/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:37.318487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:37.428980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac6522-bc3e-413a-aee9-ab418aac667b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:37.469174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:37.469869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:37.470155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:37.470427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:37.471340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:37.471779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:37.473409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:37.498670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 625/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Wed May 11 07:28:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:28:37.500108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:37.602337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2586-ef94-4091-9e42-4550ddfd08dc None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:37.638247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c8b61-9bdb-4f5d-8b17-0b5107867540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:37.638879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c8b61-9bdb-4f5d-8b17-0b5107867540 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:37.639161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c8b61-9bdb-4f5d-8b17-0b5107867540 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:37.639431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c8b61-9bdb-4f5d-8b17-0b5107867540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:37.709597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c8b61-9bdb-4f5d-8b17-0b5107867540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:37.711172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c8b61-9bdb-4f5d-8b17-0b5107867540 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:37.813463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 630/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:28:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:28:37.819216 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:37.931221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da470a-d9c0-4f54-9816-a257935bfcf1 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:37.968527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:37.969357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:37.969683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:37.969974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:37.980753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:37.982234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:37.999485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:38.000628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:38.001897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:38.001897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:38.001897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:38.001897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:38.001897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 626/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:38.006603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c8b61-9bdb-4f5d-8b17-0b5107867540 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:38.117289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c8b61-9bdb-4f5d-8b17-0b5107867540 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:38.154706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2a08-464f-4204-9627-564276386589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:38.155374 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2a08-464f-4204-9627-564276386589 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:38.155705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2a08-464f-4204-9627-564276386589 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:38.156064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b2a08-464f-4204-9627-564276386589 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:38.156946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2a08-464f-4204-9627-564276386589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:38.157276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2a08-464f-4204-9627-564276386589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:38.158860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b2a08-464f-4204-9627-564276386589 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:38.171870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 631/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:38.177825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:38.282866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeb895-99f9-43e7-89ce-951a75eab39b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:38.317511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:38.318915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:38.318915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:38.318915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:38.326850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:38.328367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:28:38.344051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:38.345057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:38.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 627/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:38.351550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2a08-464f-4204-9627-564276386589 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:38.452690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b2a08-464f-4204-9627-564276386589 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:38.487701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d8370-3142-43a5-a7e3-70c8a0a409f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:38.488383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d8370-3142-43a5-a7e3-70c8a0a409f8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:38.488669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d8370-3142-43a5-a7e3-70c8a0a409f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:38.488945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d8370-3142-43a5-a7e3-70c8a0a409f8 None admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:38.489770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d8370-3142-43a5-a7e3-70c8a0a409f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:38.490085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d8370-3142-43a5-a7e3-70c8a0a409f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:38.491536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d8370-3142-43a5-a7e3-70c8a0a409f8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:38.505052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 632/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:38.512200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:38.612496 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b80978-3290-44db-9e76-96c22dc14609 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:38.646866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb860d78-c51d-4eea-905c-a2f85308040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:38.647527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860d78-c51d-4eea-905c-a2f85308040f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:38.647809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860d78-c51d-4eea-905c-a2f85308040f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:38.648085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860d78-c51d-4eea-905c-a2f85308040f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:38.648916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb860d78-c51d-4eea-905c-a2f85308040f None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=a1b36840995045199ec96eac939d5d35) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:38.649227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb860d78-c51d-4eea-905c-a2f85308040f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:38.650796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb860d78-c51d-4eea-905c-a2f85308040f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:38.656735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 628/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:28:38 2022] GET /identity/v3/role_assignments?user.id=a1b36840995045199ec96eac939d5d35&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=de114c58fdc8476ebab657e6f9359155 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:40.890622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be598bf-f5a4-4ecb-9848-c4fb06149f05 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:40.891175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be598bf-f5a4-4ecb-9848-c4fb06149f05 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:40.891175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be598bf-f5a4-4ecb-9848-c4fb06149f05 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:40.892459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 633/1261] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:28:40.898218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5360cb-07c7-489e-8935-cbfe11ac08e3 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:40.898653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5360cb-07c7-489e-8935-cbfe11ac08e3 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:40.898938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5360cb-07c7-489e-8935-cbfe11ac08e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:40.918899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2f5360cb-07c7-489e-8935-cbfe11ac08e3 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:40.920191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2f5360cb-07c7-489e-8935-cbfe11ac08e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:40.991030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 629/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:41.022437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be598bf-f5a4-4ecb-9848-c4fb06149f05 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:41.116596 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be598bf-f5a4-4ecb-9848-c4fb06149f05 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:41.148210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86883bb3-aa8c-4b5e-9860-168d7302f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:41.148920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86883bb3-aa8c-4b5e-9860-168d7302f115 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:41.149201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86883bb3-aa8c-4b5e-9860-168d7302f115 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:41.149473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86883bb3-aa8c-4b5e-9860-168d7302f115 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:41.159614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86883bb3-aa8c-4b5e-9860-168d7302f115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-86883bb3-aa8c-4b5e-9860-168d7302f115 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:28:41.168002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:41.169160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:41.170299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 634/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:28:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:41.175743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5360cb-07c7-489e-8935-cbfe11ac08e3 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:41.267599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5360cb-07c7-489e-8935-cbfe11ac08e3 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:41.299318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:41.299970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:41.300255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:41.300531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:41.301268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:41.301595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:41.302983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:41.311093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 630/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:41.316961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86883bb3-aa8c-4b5e-9860-168d7302f115 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:41.414820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86883bb3-aa8c-4b5e-9860-168d7302f115 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:41.446029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:41.446803 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:41.447696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:41.447971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:41.457351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:41.458825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:41.475376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:41.476438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:41.477532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:41.477532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:41.477532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:41.477532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:41.477532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 635/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:41.482818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:41.576431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9a6b-ee5f-4f16-ae25-e86e8ddf0383 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:41.606586 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:41.607225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:41.607506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:41.607780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:41.608487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:41.608788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:41.610169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:41.621585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 631/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:41.627109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:41.726280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230ab1-e7f4-46ab-8b72-4f17dc79caa7 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:41.760232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:41.761017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:41.761294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:41.761583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:41.768078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:41.769499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:28:41.783527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:41.784417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:41.785467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 636/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:41.790428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:41.884141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d67d2-a15f-4e1e-8cf6-094e7da2aea8 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:41.918319 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:41.919028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:41.919236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:41.919513 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:41.920340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:41.920649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:41.922118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:41.939405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 632/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Wed May 11 07:28:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:41.944980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:42.037633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0532a-d470-4b63-9b3b-031afb5303d4 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:42.070012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:42.070789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:42.071066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:42.071332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:42.080757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:42.082212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:42.099273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:42.100286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:42.101531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:42.101531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:42.101531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:42.101531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:42.101531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 637/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:42.106770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:42.197989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb53100-6e13-4cd8-9f2c-f342c4cb42ea None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:42.230592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:42.231239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:42.231522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:42.231795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:42.232506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:42.232813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:42.234196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:42.244800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 633/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:42.250412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:42.346887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f4e40-1c32-4251-83fa-e5f2676d733c None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:42.379954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:42.380730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:42.381005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:42.381273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:42.387573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:42.389010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:28:42.402590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:42.403613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:42.404623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 638/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 07:28:42.409676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:42.503349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ec4ab-35e7-49e8-a77e-20348219c53b None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:42.535016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d111ac-a5cc-42c3-bfae-ee25cba2fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:42.535661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d111ac-a5cc-42c3-bfae-ee25cba2fed3 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:42.535943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d111ac-a5cc-42c3-bfae-ee25cba2fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:42.536214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d111ac-a5cc-42c3-bfae-ee25cba2fed3 None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:42.536986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d111ac-a5cc-42c3-bfae-ee25cba2fed3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:42.537291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d111ac-a5cc-42c3-bfae-ee25cba2fed3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:42.538736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d111ac-a5cc-42c3-bfae-ee25cba2fed3 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:42.550016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 634/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:42.555914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:42.651042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b6ee-8746-4fdd-8e86-7d398eb8047d None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:42.681647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad68112-ffe3-40ce-8289-a6db95f7409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:42.682515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad68112-ffe3-40ce-8289-a6db95f7409e None admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:42.682791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad68112-ffe3-40ce-8289-a6db95f7409e None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:42.683059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad68112-ffe3-40ce-8289-a6db95f7409e None admin] PATH_INFO: `/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/a1b36840995045199ec96eac939d5d35/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:42.684952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad68112-ffe3-40ce-8289-a6db95f7409e None admin] RBAC: Authorizing `identity:create_grant(project_id=58efa4f00d6644479ff58fc39fcbde19, user_id=a1b36840995045199ec96eac939d5d35, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:42.686403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad68112-ffe3-40ce-8289-a6db95f7409e None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:42.698954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 639/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Wed May 11 07:28:42 2022] PUT /identity/v3/projects/58efa4f00d6644479ff58fc39fcbde19/users/a1b36840995045199ec96eac939d5d35/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:28:44.843759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664419-749f-4d40-b852-4c8877c7acd7 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:44.844279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664419-749f-4d40-b852-4c8877c7acd7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:44.844279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73664419-749f-4d40-b852-4c8877c7acd7 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:44.845625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 635/1274] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:44.850786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789269-a36a-49dc-a874-9d8b251fa77b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:44.851152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789269-a36a-49dc-a874-9d8b251fa77b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:44.851332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2789269-a36a-49dc-a874-9d8b251fa77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:44.867298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f2789269-a36a-49dc-a874-9d8b251fa77b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:44.868466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f2789269-a36a-49dc-a874-9d8b251fa77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:44.935325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 640/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:44.958983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73664419-749f-4d40-b852-4c8877c7acd7 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:45.053550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73664419-749f-4d40-b852-4c8877c7acd7 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:45.085266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff92bcd-2e44-4606-9de5-5ec72950ac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:45.086066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92bcd-2e44-4606-9de5-5ec72950ac6a None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:45.086348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92bcd-2e44-4606-9de5-5ec72950ac6a None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:45.086617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92bcd-2e44-4606-9de5-5ec72950ac6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:45.096826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff92bcd-2e44-4606-9de5-5ec72950ac6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-7ff92bcd-2e44-4606-9de5-5ec72950ac6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 07:28:45.104398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:45.105473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:45.106779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 636/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Wed May 11 07:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:45.111496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2789269-a36a-49dc-a874-9d8b251fa77b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:45.204224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2789269-a36a-49dc-a874-9d8b251fa77b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:45.235005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:45.235652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:45.235934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:45.236207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:45.236943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:45.237251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:45.238655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:45.246774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 641/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Wed May 11 07:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:28:45.252109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff92bcd-2e44-4606-9de5-5ec72950ac6a None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:45.347339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff92bcd-2e44-4606-9de5-5ec72950ac6a None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:45.378357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:45.379130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:45.379410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:45.379679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:45.390101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:45.391538 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:45.407781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:45.408866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:45.410138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:45.410138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:45.410138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:45.410138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:45.410138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 637/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:45.414625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:45.509129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d59e00-91fa-4b4b-8e8d-f8d38c20ad36 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:45.539702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:45.540347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:45.541112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:45.541383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:45.542238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:45.542543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:45.543890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:45.554849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 642/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:45.561008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:45.654331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb16f00-2209-4a78-9ed9-9fb100d8784e None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:45.686026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:45.686803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:45.687345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:45.687615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:45.694632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:45.696051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 07:28:45.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:45.710963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:45.712296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 638/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:45.716574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:45.809356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687c009-7f4b-4afb-98f1-5d2331d1b668 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:45.841009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:45.841691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:45.841981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:45.842260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:45.843086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:45.843397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:45.844804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:45.861204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 643/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Wed May 11 07:28:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:45.866557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:45.961905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4936ad-f719-4025-bcaf-2100d4dd031f None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:45.993819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446910f-e266-4913-94da-7260506edf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:45.994458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446910f-e266-4913-94da-7260506edf16 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:45.994744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446910f-e266-4913-94da-7260506edf16 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:45.995021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446910f-e266-4913-94da-7260506edf16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:46.061032 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446910f-e266-4913-94da-7260506edf16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:46.062806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446910f-e266-4913-94da-7260506edf16 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:46.153372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 639/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Wed May 11 07:28:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 07:28:46.159194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:46.251838 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45705bad-b70d-4b4c-9524-076680b0f494 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:46.284554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:46.285327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:46.285638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:46.285914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:46.295402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:46.296848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 07:28:46.314276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:46.315333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:46.316420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 07:28:46.316420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 07:28:46.316420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 07:28:46.316420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:46.316420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 644/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:46.321052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446910f-e266-4913-94da-7260506edf16 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:46.418516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446910f-e266-4913-94da-7260506edf16 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:46.451754 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:46.452410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:46.452697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:46.452973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:46.453734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:46.454043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:46.455414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:46.466280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 640/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Wed May 11 07:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:46.471731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:46.564257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467d112-18d0-4466-967b-2b41d6f9266b None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:46.595588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:46.596362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:46.596643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:46.596919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:46.603812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:46.605235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 07:28:46.618517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application with Lock( May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:46.619546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: ERROR keystone.server.flask.application May 11 07:28:46.620633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 645/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Wed May 11 07:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:46.625380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:46.717695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78e09d-68c6-49f5-86e2-ff6bb4587a78 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:46.748464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784872-0591-4b4c-9219-7d11cabd99ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:46.749098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784872-0591-4b4c-9219-7d11cabd99ec None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:46.749375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784872-0591-4b4c-9219-7d11cabd99ec None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:46.749676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784872-0591-4b4c-9219-7d11cabd99ec None admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:46.750451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784872-0591-4b4c-9219-7d11cabd99ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:46.750758 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784872-0591-4b4c-9219-7d11cabd99ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:46.752171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784872-0591-4b4c-9219-7d11cabd99ec None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:46.763265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 641/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Wed May 11 07:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:28:46.769256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:46.861026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798a739-24e5-41b0-8f44-8970e43c75a8 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:46.894197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb1c58-de57-4c0b-aae5-b967533ba48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:46.894887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb1c58-de57-4c0b-aae5-b967533ba48b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:46.895095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb1c58-de57-4c0b-aae5-b967533ba48b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:46.895419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb1c58-de57-4c0b-aae5-b967533ba48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:46.896187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb1c58-de57-4c0b-aae5-b967533ba48b None admin] RBAC: Adding query filter params (role.id=de114c58fdc8476ebab657e6f9359155, scope.project.id=58efa4f00d6644479ff58fc39fcbde19, user.id=a1b36840995045199ec96eac939d5d35) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:46.896510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb1c58-de57-4c0b-aae5-b967533ba48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:46.897994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb1c58-de57-4c0b-aae5-b967533ba48b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:46.904428 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 646/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Wed May 11 07:28:46 2022] GET /identity/v3/role_assignments?user.id=a1b36840995045199ec96eac939d5d35&scope.project.id=58efa4f00d6644479ff58fc39fcbde19&role.id=de114c58fdc8476ebab657e6f9359155 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:49.111882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08820-3647-43f9-a0ac-665608814a87 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:49.112410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08820-3647-43f9-a0ac-665608814a87 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:49.112410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08820-3647-43f9-a0ac-665608814a87 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:49.113831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 642/1288] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:49.118970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633111c-8aa2-41f4-a7b1-40098c33dddd None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:49.119370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633111c-8aa2-41f4-a7b1-40098c33dddd None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:49.119533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633111c-8aa2-41f4-a7b1-40098c33dddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:49.135569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1633111c-8aa2-41f4-a7b1-40098c33dddd None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:49.136743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1633111c-8aa2-41f4-a7b1-40098c33dddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:49.198362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 647/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:49.220803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08820-3647-43f9-a0ac-665608814a87 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:49.314367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08820-3647-43f9-a0ac-665608814a87 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:49.346091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:49.346868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:49.347150 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:49.347426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:49.348066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:49.349410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:49.361024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:49.362293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:49.363153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 643/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:28:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:49.368026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633111c-8aa2-41f4-a7b1-40098c33dddd None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:49.459436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633111c-8aa2-41f4-a7b1-40098c33dddd None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:49.491167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a666aa5-6f74-4c61-8371-d516e53467f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:49.491824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a666aa5-6f74-4c61-8371-d516e53467f9 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:49.492104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a666aa5-6f74-4c61-8371-d516e53467f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:49.492374 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a666aa5-6f74-4c61-8371-d516e53467f9 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:49.493066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a666aa5-6f74-4c61-8371-d516e53467f9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:49.493370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a666aa5-6f74-4c61-8371-d516e53467f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:49.494793 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a666aa5-6f74-4c61-8371-d516e53467f9 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:49.499325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 648/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Wed May 11 07:28:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:49.504930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:49.598736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfcdce-276f-4d72-a384-50f75219fc26 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:49.630506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c7771-6b4e-4e03-b8e0-bc889dff39c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:49.631087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7771-6b4e-4e03-b8e0-bc889dff39c5 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:49.631370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7771-6b4e-4e03-b8e0-bc889dff39c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:49.631645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c7771-6b4e-4e03-b8e0-bc889dff39c5 None admin] PATH_INFO: `/v3/services` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:49.632342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c7771-6b4e-4e03-b8e0-bc889dff39c5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:49.632648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c7771-6b4e-4e03-b8e0-bc889dff39c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:49.634028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c7771-6b4e-4e03-b8e0-bc889dff39c5 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:49.638755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 644/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Wed May 11 07:28:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:51.815940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ad19-f203-46d0-aa4a-749c9536101b None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:51.816438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ad19-f203-46d0-aa4a-749c9536101b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:51.816438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46ad19-f203-46d0-aa4a-749c9536101b None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:51.817783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 649/1293] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:51.822922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abaf6-cf2b-4676-964e-af0076ba10ea None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:51.823339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abaf6-cf2b-4676-964e-af0076ba10ea None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:51.823482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abaf6-cf2b-4676-964e-af0076ba10ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:51.840024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8b9abaf6-cf2b-4676-964e-af0076ba10ea None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:51.841189 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8b9abaf6-cf2b-4676-964e-af0076ba10ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:51.911008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 645/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:51.934988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ad19-f203-46d0-aa4a-749c9536101b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:52.031657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46ad19-f203-46d0-aa4a-749c9536101b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:52.063525 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2def8-87ce-4120-8b5b-120f98648ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:52.064176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2def8-87ce-4120-8b5b-120f98648ba1 None admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:52.064458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2def8-87ce-4120-8b5b-120f98648ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:52.064736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2def8-87ce-4120-8b5b-120f98648ba1 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:52.065443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2def8-87ce-4120-8b5b-120f98648ba1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:52.066884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2def8-87ce-4120-8b5b-120f98648ba1 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:52.078928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 650/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Wed May 11 07:28:51 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:28:54.271069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a26020-5aa5-4b83-83f5-f0a8a172da59 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:54.271595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a26020-5aa5-4b83-83f5-f0a8a172da59 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:54.271595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a26020-5aa5-4b83-83f5-f0a8a172da59 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:54.273018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 646/1296] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:54.278749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c64e-d550-4083-8658-74cdbe48081e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:54.279177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c64e-d550-4083-8658-74cdbe48081e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:54.279303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2c64e-d550-4083-8658-74cdbe48081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:54.296538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f4a2c64e-d550-4083-8658-74cdbe48081e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:54.297741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f4a2c64e-d550-4083-8658-74cdbe48081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:54.364963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 651/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 07:28:54.386614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a26020-5aa5-4b83-83f5-f0a8a172da59 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:54.484958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a26020-5aa5-4b83-83f5-f0a8a172da59 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:54.516954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:54.517766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:54.518047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:54.518320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:54.518962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:54.520322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:54.532522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:54.533689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:54.534944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 647/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:28:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:54.539665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2c64e-d550-4083-8658-74cdbe48081e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:54.631260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2c64e-d550-4083-8658-74cdbe48081e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:54.663362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:54.664010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:54.664295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:54.664568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:54.665295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:54.665634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:54.666994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:54.671917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 652/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Wed May 11 07:28:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:54.677667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:54.771320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5764-f22f-480a-86de-6696ad3b1c37 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:54.808206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ceef52-0dbf-4608-a652-8b109548e136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:54.808779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceef52-0dbf-4608-a652-8b109548e136 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:54.809118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceef52-0dbf-4608-a652-8b109548e136 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:54.809390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ceef52-0dbf-4608-a652-8b109548e136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:54.810207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceef52-0dbf-4608-a652-8b109548e136 None admin] RBAC: Adding query filter params (interface=public, service_id=24123b42feaf4fc8a46e6089b8059fc0, region_id=RegionOne) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:54.810513 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceef52-0dbf-4608-a652-8b109548e136 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:54.811929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ceef52-0dbf-4608-a652-8b109548e136 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:54.817318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 648/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Wed May 11 07:28:54 2022] GET /identity/v3/endpoints?service_id=24123b42feaf4fc8a46e6089b8059fc0&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:54.823521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:54.914880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19501671-8789-4e71-bc3f-c745cb5dc735 None admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:54.945951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767707c-bfc9-4cbb-98ac-52bf1c0a948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:54.947154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767707c-bfc9-4cbb-98ac-52bf1c0a948b None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:54.947431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767707c-bfc9-4cbb-98ac-52bf1c0a948b None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:54.947695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767707c-bfc9-4cbb-98ac-52bf1c0a948b None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:54.948351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767707c-bfc9-4cbb-98ac-52bf1c0a948b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:54.949721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767707c-bfc9-4cbb-98ac-52bf1c0a948b None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:54.956066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 653/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Wed May 11 07:28:54 2022] GET /identity/v3/services => generated 2191 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:28:57.131885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fdd6b-affd-4704-8f62-0bb17860943e None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:57.132449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fdd6b-affd-4704-8f62-0bb17860943e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:57.132449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fdd6b-affd-4704-8f62-0bb17860943e None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:57.134077 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 649/1302] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:28:57.139088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638af4-ce1a-4161-a3ef-981ab13df86e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:57.139504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638af4-ce1a-4161-a3ef-981ab13df86e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:57.139649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84638af4-ce1a-4161-a3ef-981ab13df86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:57.156185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-84638af4-ce1a-4161-a3ef-981ab13df86e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:28:57.157363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-84638af4-ce1a-4161-a3ef-981ab13df86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:28:57.219712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 654/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:28:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 07:28:57.242456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fdd6b-affd-4704-8f62-0bb17860943e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:57.338531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fdd6b-affd-4704-8f62-0bb17860943e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:57.370289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:57.371071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:57.371358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:57.371636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:57.372282 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:57.373667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 07:28:57.386172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 07:28:57.387341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.get_or_create( May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application with Lock( May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self._enter() May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application return self.creator() May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application created_value = creator( May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: ERROR keystone.server.flask.application May 11 07:28:57.388395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 650/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Wed May 11 07:28:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 07:28:57.393122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84638af4-ce1a-4161-a3ef-981ab13df86e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:57.489948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84638af4-ce1a-4161-a3ef-981ab13df86e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:57.523845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aff9ca-dcc0-496d-a3b0-f4a5e652d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:57.524516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aff9ca-dcc0-496d-a3b0-f4a5e652d687 None admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:57.524800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aff9ca-dcc0-496d-a3b0-f4a5e652d687 None admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:57.525072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aff9ca-dcc0-496d-a3b0-f4a5e652d687 None admin] PATH_INFO: `/v3/services` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:57.525803 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aff9ca-dcc0-496d-a3b0-f4a5e652d687 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:28:57.526114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aff9ca-dcc0-496d-a3b0-f4a5e652d687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:57.527469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aff9ca-dcc0-496d-a3b0-f4a5e652d687 None admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:57.532310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 655/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Wed May 11 07:28:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:28:57.538131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:28:57.632249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae6f18-702c-457d-9f7c-aaa19112c697 None admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:28:57.662907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea491d29-e470-434f-bf3c-e17e4196afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:28:57.663537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491d29-e470-434f-bf3c-e17e4196afc6 None admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:28:57.663818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491d29-e470-434f-bf3c-e17e4196afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:28:57.664092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea491d29-e470-434f-bf3c-e17e4196afc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:28:57.664822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491d29-e470-434f-bf3c-e17e4196afc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:28:57.666716 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea491d29-e470-434f-bf3c-e17e4196afc6 None admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:28:57.684453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 651/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Wed May 11 07:28:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:30:01.383966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7b743-c54e-492a-8c20-32afdab09b25 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:01.384375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7b743-c54e-492a-8c20-32afdab09b25 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:01.384598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7b743-c54e-492a-8c20-32afdab09b25 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:01.391484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fba501-a848-45d0-be4e-10134f71292e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:01.392988 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fba501-a848-45d0-be4e-10134f71292e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:01.394119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fba501-a848-45d0-be4e-10134f71292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:01.399470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 656/1307] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:01 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:01.570644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-83fba501-a848-45d0-be4e-10134f71292e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:01.572072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-83fba501-a848-45d0-be4e-10134f71292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:01.684125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 652/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:01.735294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325792-176f-45ac-b7a9-bb671c147bf4 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:01.735583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325792-176f-45ac-b7a9-bb671c147bf4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:01.736057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325792-176f-45ac-b7a9-bb671c147bf4 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:01.737643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 657/1309] 10.222.0.36 () {54 vars in 964 bytes} [Wed May 11 07:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:01.744599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a9fd-7741-453e-94b0-7decaceab2de None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:01.744887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a9fd-7741-453e-94b0-7decaceab2de None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:01.745348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869a9fd-7741-453e-94b0-7decaceab2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:01.821196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e869a9fd-7741-453e-94b0-7decaceab2de None None] MFA Rules not processed for user `66b60e827f404e3891e4f24ca842e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:01.822344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e869a9fd-7741-453e-94b0-7decaceab2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:01.897107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 653/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Wed May 11 07:30:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:01.906618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325792-176f-45ac-b7a9-bb671c147bf4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:01.908338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e4325792-176f-45ac-b7a9-bb671c147bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:02.020634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325792-176f-45ac-b7a9-bb671c147bf4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:02.093789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0472dec-40ce-43e8-b75c-b3e8c719aa87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:02.094435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472dec-40ce-43e8-b75c-b3e8c719aa87 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:02.094710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472dec-40ce-43e8-b75c-b3e8c719aa87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:02.094984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0472dec-40ce-43e8-b75c-b3e8c719aa87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:02.096693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a0472dec-40ce-43e8-b75c-b3e8c719aa87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:02.202761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0472dec-40ce-43e8-b75c-b3e8c719aa87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:02.204224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0472dec-40ce-43e8-b75c-b3e8c719aa87 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:02.224885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 658/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:05.107695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eae6c-2dad-468e-bfbd-bc1df77c2f3a None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:05.108196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eae6c-2dad-468e-bfbd-bc1df77c2f3a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:05.108401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36eae6c-2dad-468e-bfbd-bc1df77c2f3a None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:05.110645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 654/1312] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:05.117758 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9693e-07cf-4397-9838-76890a72d2bf None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:05.118288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9693e-07cf-4397-9838-76890a72d2bf None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:05.118402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9693e-07cf-4397-9838-76890a72d2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:05.199354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-30e9693e-07cf-4397-9838-76890a72d2bf None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:05.200583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-30e9693e-07cf-4397-9838-76890a72d2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:05.302394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 659/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:05.340709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36eae6c-2dad-468e-bfbd-bc1df77c2f3a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:05.342264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d36eae6c-2dad-468e-bfbd-bc1df77c2f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:05.447717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36eae6c-2dad-468e-bfbd-bc1df77c2f3a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:05.525059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe35b2-655c-40f3-81f6-a17fbc6622b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:05.526390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe35b2-655c-40f3-81f6-a17fbc6622b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:05.526688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe35b2-655c-40f3-81f6-a17fbc6622b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:05.526981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe35b2-655c-40f3-81f6-a17fbc6622b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:05.528660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-93fe35b2-655c-40f3-81f6-a17fbc6622b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:05.643432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe35b2-655c-40f3-81f6-a17fbc6622b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:05.644886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe35b2-655c-40f3-81f6-a17fbc6622b4 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:05.664267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 655/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:08.257201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad2f6-2cbe-4f3f-aba3-8f50edcb13aa None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:08.257744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad2f6-2cbe-4f3f-aba3-8f50edcb13aa None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:08.257744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ad2f6-2cbe-4f3f-aba3-8f50edcb13aa None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:08.259104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 660/1315] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:08.264292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9666e-5844-44f7-9f6a-8e3deff90ced None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:08.264672 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9666e-5844-44f7-9f6a-8e3deff90ced None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:08.264845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9666e-5844-44f7-9f6a-8e3deff90ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:08.325665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-eae9666e-5844-44f7-9f6a-8e3deff90ced None None] MFA Rules not processed for user `92deee10b3eb491899613162290b0a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:08.326851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-eae9666e-5844-44f7-9f6a-8e3deff90ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:08.418342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 656/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:30:08.473828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523503c-b44b-41b5-a329-863d44e26750 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:08.474111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523503c-b44b-41b5-a329-863d44e26750 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:08.474389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523503c-b44b-41b5-a329-863d44e26750 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:08.475959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 661/1317] 10.222.0.36 () {54 vars in 964 bytes} [Wed May 11 07:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:08.482105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e750-ee61-4919-9528-40f7634ee522 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:08.482397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e750-ee61-4919-9528-40f7634ee522 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:08.482673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e750-ee61-4919-9528-40f7634ee522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:08.562452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-de80e750-ee61-4919-9528-40f7634ee522 None None] MFA Rules not processed for user `66b60e827f404e3891e4f24ca842e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:08.563605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-de80e750-ee61-4919-9528-40f7634ee522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:08.635787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 657/1318] 10.222.0.36 () {58 vars in 1061 bytes} [Wed May 11 07:30:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:30:08.644820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523503c-b44b-41b5-a329-863d44e26750 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:08.646403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b523503c-b44b-41b5-a329-863d44e26750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:08.746113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523503c-b44b-41b5-a329-863d44e26750 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:08.815764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb25ec0-67ff-4bbf-bd0d-d4f60027540d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:08.816332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb25ec0-67ff-4bbf-bd0d-d4f60027540d service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:08.816612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb25ec0-67ff-4bbf-bd0d-d4f60027540d service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:08.816884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb25ec0-67ff-4bbf-bd0d-d4f60027540d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:08.818545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-beb25ec0-67ff-4bbf-bd0d-d4f60027540d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:08.919867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb25ec0-67ff-4bbf-bd0d-d4f60027540d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:08.921292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb25ec0-67ff-4bbf-bd0d-d4f60027540d service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:08.939524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 662/1319] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:12.083528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852e04-e78b-4204-9a02-eb72fe426212 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:12.084174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852e04-e78b-4204-9a02-eb72fe426212 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:12.084174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0852e04-e78b-4204-9a02-eb72fe426212 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:12.086124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 658/1320] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:12.091235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c6cf-487d-4832-b7fc-1bec67017e5c None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:12.091643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c6cf-487d-4832-b7fc-1bec67017e5c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:12.091820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826c6cf-487d-4832-b7fc-1bec67017e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:12.153514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0826c6cf-487d-4832-b7fc-1bec67017e5c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:12.154744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0826c6cf-487d-4832-b7fc-1bec67017e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:12.251241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 663/1321] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:12.290700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0852e04-e78b-4204-9a02-eb72fe426212 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:12.292244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e0852e04-e78b-4204-9a02-eb72fe426212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:12.391014 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0852e04-e78b-4204-9a02-eb72fe426212 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:12.460457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce353ca-a200-45cc-96c3-d15e1bb87527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:12.461103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce353ca-a200-45cc-96c3-d15e1bb87527 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:12.461390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce353ca-a200-45cc-96c3-d15e1bb87527 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:12.461692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce353ca-a200-45cc-96c3-d15e1bb87527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:12.463307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1ce353ca-a200-45cc-96c3-d15e1bb87527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:12.571368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce353ca-a200-45cc-96c3-d15e1bb87527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:12.572801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce353ca-a200-45cc-96c3-d15e1bb87527 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:12.589932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 659/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:15.470980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398072fb-17b2-42b9-b97d-9bb808e3bdf8 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:15.471485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398072fb-17b2-42b9-b97d-9bb808e3bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:15.471485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398072fb-17b2-42b9-b97d-9bb808e3bdf8 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:15.472999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 664/1323] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:15.479337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daed3a-ec18-4c72-910e-1a078a8134d1 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:15.479839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daed3a-ec18-4c72-910e-1a078a8134d1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:15.480164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daed3a-ec18-4c72-910e-1a078a8134d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:15.552536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c1daed3a-ec18-4c72-910e-1a078a8134d1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:15.554434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c1daed3a-ec18-4c72-910e-1a078a8134d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:15.649472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 660/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:30:15.689506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398072fb-17b2-42b9-b97d-9bb808e3bdf8 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:15.689506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-398072fb-17b2-42b9-b97d-9bb808e3bdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:15.794110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398072fb-17b2-42b9-b97d-9bb808e3bdf8 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:15.875962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412f188-0603-4978-a044-e3a9f7bb3a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:15.876732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412f188-0603-4978-a044-e3a9f7bb3a67 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:15.877078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412f188-0603-4978-a044-e3a9f7bb3a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:15.877416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412f188-0603-4978-a044-e3a9f7bb3a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:15.879159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0412f188-0603-4978-a044-e3a9f7bb3a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:15.985144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412f188-0603-4978-a044-e3a9f7bb3a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:15.986620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412f188-0603-4978-a044-e3a9f7bb3a67 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:16.004156 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 665/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:18.264691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6180d-1d87-4d24-a186-42396e36e683 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:18.265245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6180d-1d87-4d24-a186-42396e36e683 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:18.265340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6180d-1d87-4d24-a186-42396e36e683 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:18.266707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 661/1326] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:18.272583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032645e-b8cf-4a02-953f-a452714b074a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:18.272999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032645e-b8cf-4a02-953f-a452714b074a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:18.273173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032645e-b8cf-4a02-953f-a452714b074a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:18.339442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-7032645e-b8cf-4a02-953f-a452714b074a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:18.340623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7032645e-b8cf-4a02-953f-a452714b074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:18.432680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 666/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:18.467935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6180d-1d87-4d24-a186-42396e36e683 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:18.469532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b8b6180d-1d87-4d24-a186-42396e36e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:18.569192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6180d-1d87-4d24-a186-42396e36e683 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:18.639855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1f6f3-bb8d-4343-8afc-12ca40d56083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:18.640502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1f6f3-bb8d-4343-8afc-12ca40d56083 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:18.640787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1f6f3-bb8d-4343-8afc-12ca40d56083 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:18.641053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1f6f3-bb8d-4343-8afc-12ca40d56083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:18.642699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-70d1f6f3-bb8d-4343-8afc-12ca40d56083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:18.746407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1f6f3-bb8d-4343-8afc-12ca40d56083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:18.747852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1f6f3-bb8d-4343-8afc-12ca40d56083 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:18.765780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 662/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:21.005826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7322-0603-40c7-990e-d5889fb7e1b6 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:21.006883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7322-0603-40c7-990e-d5889fb7e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:21.006989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a7322-0603-40c7-990e-d5889fb7e1b6 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:21.008364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 667/1329] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:21.013746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5db50a-ae5c-43b0-b699-f5765f5dc71b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:21.014145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5db50a-ae5c-43b0-b699-f5765f5dc71b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:21.014300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5db50a-ae5c-43b0-b699-f5765f5dc71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:21.077915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ba5db50a-ae5c-43b0-b699-f5765f5dc71b None None] MFA Rules not processed for user `92deee10b3eb491899613162290b0a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:21.079222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ba5db50a-ae5c-43b0-b699-f5765f5dc71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:21.172893 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 663/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:21.210351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a7322-0603-40c7-990e-d5889fb7e1b6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:21.211901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-292a7322-0603-40c7-990e-d5889fb7e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:21.312929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a7322-0603-40c7-990e-d5889fb7e1b6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:21.388326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e70cb-27ec-4585-800a-e15dd98eb916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:21.388996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e70cb-27ec-4585-800a-e15dd98eb916 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:21.389279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e70cb-27ec-4585-800a-e15dd98eb916 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:21.389577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e70cb-27ec-4585-800a-e15dd98eb916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:21.391192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5f1e70cb-27ec-4585-800a-e15dd98eb916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:21.499592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e70cb-27ec-4585-800a-e15dd98eb916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:21.501116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e70cb-27ec-4585-800a-e15dd98eb916 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:21.518905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 668/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:23.949080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8dd70-36c7-4a6d-ae49-606df63fafd4 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:23.949653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8dd70-36c7-4a6d-ae49-606df63fafd4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:23.949653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8dd70-36c7-4a6d-ae49-606df63fafd4 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:23.951055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 664/1332] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:23.956594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eac416-d782-4d94-8343-c6585cfb94a4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:23.957024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eac416-d782-4d94-8343-c6585cfb94a4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:23.957178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eac416-d782-4d94-8343-c6585cfb94a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:24.024951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-49eac416-d782-4d94-8343-c6585cfb94a4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:24.026309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-49eac416-d782-4d94-8343-c6585cfb94a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:24.135739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 669/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:24.171097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8dd70-36c7-4a6d-ae49-606df63fafd4 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:24.172616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0aa8dd70-36c7-4a6d-ae49-606df63fafd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:24.273286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8dd70-36c7-4a6d-ae49-606df63fafd4 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:24.343949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40460c84-bf30-45e3-976c-656e623a2564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:24.344534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460c84-bf30-45e3-976c-656e623a2564 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:24.344814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460c84-bf30-45e3-976c-656e623a2564 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:24.345088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460c84-bf30-45e3-976c-656e623a2564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:24.346767 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-40460c84-bf30-45e3-976c-656e623a2564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:24.452996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40460c84-bf30-45e3-976c-656e623a2564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:24.454573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40460c84-bf30-45e3-976c-656e623a2564 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:24.472309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 665/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:26.746722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6973-9fa8-4a1d-bb0e-9aece480b725 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:26.747235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6973-9fa8-4a1d-bb0e-9aece480b725 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:26.747235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e6973-9fa8-4a1d-bb0e-9aece480b725 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:26.748562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 670/1335] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:26.753808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580657-b6e7-4de9-9210-f1df93e2f4bb None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:26.754258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580657-b6e7-4de9-9210-f1df93e2f4bb None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:26.754353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4580657-b6e7-4de9-9210-f1df93e2f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:26.816276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a4580657-b6e7-4de9-9210-f1df93e2f4bb None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:26.817456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a4580657-b6e7-4de9-9210-f1df93e2f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:26.907883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 666/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:26.947703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e6973-9fa8-4a1d-bb0e-9aece480b725 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:26.949240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-df9e6973-9fa8-4a1d-bb0e-9aece480b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:27.046912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e6973-9fa8-4a1d-bb0e-9aece480b725 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:27.117946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfd98d-4461-4910-b7b2-b52d44ef1f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:27.118595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd98d-4461-4910-b7b2-b52d44ef1f66 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:27.118876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd98d-4461-4910-b7b2-b52d44ef1f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:27.119149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd98d-4461-4910-b7b2-b52d44ef1f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:27.120758 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-71cfd98d-4461-4910-b7b2-b52d44ef1f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:27.222531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfd98d-4461-4910-b7b2-b52d44ef1f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:27.223961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfd98d-4461-4910-b7b2-b52d44ef1f66 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:27.241494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 671/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:29.932559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3087c-7fe3-4e73-80b3-8560f8fdc15a None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:29.933103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3087c-7fe3-4e73-80b3-8560f8fdc15a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:29.933103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3087c-7fe3-4e73-80b3-8560f8fdc15a None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:29.934536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 667/1338] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:29.940108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfeb23-7807-4b48-9ab4-dc8841f3ed36 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:29.940627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfeb23-7807-4b48-9ab4-dc8841f3ed36 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:29.940724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfeb23-7807-4b48-9ab4-dc8841f3ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:30.011968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8bcfeb23-7807-4b48-9ab4-dc8841f3ed36 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:30.014007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8bcfeb23-7807-4b48-9ab4-dc8841f3ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:30.116941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 672/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:30.152123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3087c-7fe3-4e73-80b3-8560f8fdc15a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:30.153855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e5c3087c-7fe3-4e73-80b3-8560f8fdc15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:30.255221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3087c-7fe3-4e73-80b3-8560f8fdc15a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:30.326720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155fde58-0db8-4003-b0e9-391175d2e726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:30.327377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fde58-0db8-4003-b0e9-391175d2e726 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:30.327667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fde58-0db8-4003-b0e9-391175d2e726 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:30.327948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fde58-0db8-4003-b0e9-391175d2e726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:30.329683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-155fde58-0db8-4003-b0e9-391175d2e726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:30.445879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fde58-0db8-4003-b0e9-391175d2e726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:30.447334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155fde58-0db8-4003-b0e9-391175d2e726 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:30.464746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 668/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:34.934482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dc138-414d-4710-99eb-4ac9ded512c3 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:34.935010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dc138-414d-4710-99eb-4ac9ded512c3 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:34.935094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dc138-414d-4710-99eb-4ac9ded512c3 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:34.936647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 673/1341] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:34.942226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af111e-055b-436f-a30e-24c9b9299b06 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:34.942711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af111e-055b-436f-a30e-24c9b9299b06 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:34.942819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af111e-055b-436f-a30e-24c9b9299b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:35.020904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-44af111e-055b-436f-a30e-24c9b9299b06 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:35.022739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-44af111e-055b-436f-a30e-24c9b9299b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:35.130984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 669/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:35.169034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dc138-414d-4710-99eb-4ac9ded512c3 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:35.172083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ca3dc138-414d-4710-99eb-4ac9ded512c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:35.274186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dc138-414d-4710-99eb-4ac9ded512c3 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:35.277884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d23c75-29d2-40ec-af96-01943d518c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:35.278538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d23c75-29d2-40ec-af96-01943d518c7e service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:35.278818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d23c75-29d2-40ec-af96-01943d518c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:35.279092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d23c75-29d2-40ec-af96-01943d518c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:35.289453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d23c75-29d2-40ec-af96-01943d518c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:35.291165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d23c75-29d2-40ec-af96-01943d518c7e service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:35.301855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 674/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:38.189691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270b55-d932-435e-8068-416d91936d77 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:38.190207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270b55-d932-435e-8068-416d91936d77 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:38.190423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270b55-d932-435e-8068-416d91936d77 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:38.191929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 670/1344] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:38.197827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882f9a-43b2-4b19-8e43-b5fb67889f7e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:38.198238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882f9a-43b2-4b19-8e43-b5fb67889f7e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:38.198330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882f9a-43b2-4b19-8e43-b5fb67889f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:38.225818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b0882f9a-43b2-4b19-8e43-b5fb67889f7e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:38.227016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b0882f9a-43b2-4b19-8e43-b5fb67889f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:38.302153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 675/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:38.339637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00270b55-d932-435e-8068-416d91936d77 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:38.350383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00270b55-d932-435e-8068-416d91936d77 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:38.353975 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b5c86-6ddb-4ff2-8569-6c4d5b765b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:38.354682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b5c86-6ddb-4ff2-8569-6c4d5b765b5d service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:38.355034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b5c86-6ddb-4ff2-8569-6c4d5b765b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:38.355382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b5c86-6ddb-4ff2-8569-6c4d5b765b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:38.364336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b5c86-6ddb-4ff2-8569-6c4d5b765b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:38.366417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b5c86-6ddb-4ff2-8569-6c4d5b765b5d service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:38.375823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 671/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:42.674337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90182a-48d0-4a72-a7a2-432a2264f43c None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:42.674805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90182a-48d0-4a72-a7a2-432a2264f43c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:42.674908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90182a-48d0-4a72-a7a2-432a2264f43c None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:42.676260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 676/1347] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:42.682200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699226-d43a-43d7-954c-dd54bdee093d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:42.682662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699226-d43a-43d7-954c-dd54bdee093d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:42.682768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4699226-d43a-43d7-954c-dd54bdee093d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:42.700434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a4699226-d43a-43d7-954c-dd54bdee093d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:42.701650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a4699226-d43a-43d7-954c-dd54bdee093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:42.709315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 672/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:42.747101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90182a-48d0-4a72-a7a2-432a2264f43c None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:42.757736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90182a-48d0-4a72-a7a2-432a2264f43c None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:42.761204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e32bc9-6c89-4700-9201-3f57fa51a881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:42.761907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32bc9-6c89-4700-9201-3f57fa51a881 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:42.762193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32bc9-6c89-4700-9201-3f57fa51a881 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:42.762468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e32bc9-6c89-4700-9201-3f57fa51a881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:42.771590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e32bc9-6c89-4700-9201-3f57fa51a881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:42.773087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e32bc9-6c89-4700-9201-3f57fa51a881 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:42.782236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 677/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:30:48.217443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5c21-1c81-4b5c-83f6-221fdbb02347 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:48.218041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5c21-1c81-4b5c-83f6-221fdbb02347 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:48.218041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5c21-1c81-4b5c-83f6-221fdbb02347 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:48.219377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 673/1350] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:48.225701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e24e-6f8b-4b7c-9896-8a7da96f44a9 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:48.226119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e24e-6f8b-4b7c-9896-8a7da96f44a9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:48.226440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3e24e-6f8b-4b7c-9896-8a7da96f44a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:48.302718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d7a3e24e-6f8b-4b7c-9896-8a7da96f44a9 None None] MFA Rules not processed for user `a1b36840995045199ec96eac939d5d35`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:48.304028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d7a3e24e-6f8b-4b7c-9896-8a7da96f44a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:48.392362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 678/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:30:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:52.517490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82771-41d2-49e5-ac47-3767d0096bc6 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:52.518047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82771-41d2-49e5-ac47-3767d0096bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:52.518047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82771-41d2-49e5-ac47-3767d0096bc6 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:52.519534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 674/1352] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:52.524530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e5a-f0ba-4a72-acca-d638bb144ef2 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:52.524979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e5a-f0ba-4a72-acca-d638bb144ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:52.525092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e5a-f0ba-4a72-acca-d638bb144ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:52.543561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c70d1e5a-f0ba-4a72-acca-d638bb144ef2 None None] MFA Rules not processed for user `a1b36840995045199ec96eac939d5d35`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:52.545033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c70d1e5a-f0ba-4a72-acca-d638bb144ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:52.554442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 679/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:30:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:54.263949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783daba8-7c97-483b-8097-cc35bf1592e6 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:54.264506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783daba8-7c97-483b-8097-cc35bf1592e6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:54.264506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783daba8-7c97-483b-8097-cc35bf1592e6 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:54.265907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 675/1354] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:54.271209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f2a0-7cc6-4dc3-a1a6-01664046682a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:54.271619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f2a0-7cc6-4dc3-a1a6-01664046682a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:54.271890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0f2a0-7cc6-4dc3-a1a6-01664046682a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:54.290303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-53d0f2a0-7cc6-4dc3-a1a6-01664046682a None None] MFA Rules not processed for user `a1b36840995045199ec96eac939d5d35`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:54.291563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-53d0f2a0-7cc6-4dc3-a1a6-01664046682a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:54.299896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 680/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:30:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:30:58.151581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd9e7-777a-4e5e-b12a-8f37b64c96f9 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:58.152185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd9e7-777a-4e5e-b12a-8f37b64c96f9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:58.152185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fd9e7-777a-4e5e-b12a-8f37b64c96f9 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:58.153554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 676/1356] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:30:58.158776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818975c-77ed-4299-8de9-fc7a8004cd4a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:58.159221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818975c-77ed-4299-8de9-fc7a8004cd4a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:58.159389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818975c-77ed-4299-8de9-fc7a8004cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:58.178548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6818975c-77ed-4299-8de9-fc7a8004cd4a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:58.179768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6818975c-77ed-4299-8de9-fc7a8004cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:58.189656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 681/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:30:58.238265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd8863-fac1-42af-b8ee-a9ffc8f21183 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:58.238564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd8863-fac1-42af-b8ee-a9ffc8f21183 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:58.239413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd8863-fac1-42af-b8ee-a9ffc8f21183 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:58.240781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 677/1358] 10.222.0.36 () {54 vars in 961 bytes} [Wed May 11 07:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:30:58.246523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6398-3223-44c9-84fe-5c2ab45b81b0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:58.246815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6398-3223-44c9-84fe-5c2ab45b81b0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:58.247097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6398-3223-44c9-84fe-5c2ab45b81b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:58.305923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-867e6398-3223-44c9-84fe-5c2ab45b81b0 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:30:58.307220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-867e6398-3223-44c9-84fe-5c2ab45b81b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:30:58.393332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 682/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Wed May 11 07:30:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:30:58.401271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd8863-fac1-42af-b8ee-a9ffc8f21183 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:30:58.416880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd8863-fac1-42af-b8ee-a9ffc8f21183 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:30:58.423084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9758a7-18bd-4799-8bdd-b6d6a4b5adf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:30:58.423834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9758a7-18bd-4799-8bdd-b6d6a4b5adf2 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:30:58.424119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9758a7-18bd-4799-8bdd-b6d6a4b5adf2 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:30:58.424451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9758a7-18bd-4799-8bdd-b6d6a4b5adf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:30:58.433855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9758a7-18bd-4799-8bdd-b6d6a4b5adf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:30:58.435460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9758a7-18bd-4799-8bdd-b6d6a4b5adf2 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:30:58.445899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 678/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:00.891706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3299628-5a6d-4cf2-8bcf-179c9a00c293 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:00.892234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3299628-5a6d-4cf2-8bcf-179c9a00c293 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:00.892234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3299628-5a6d-4cf2-8bcf-179c9a00c293 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:00.893835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 683/1361] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:31:00.899725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88398aa-5583-4633-bf4a-ea1518531ac7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:00.900209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88398aa-5583-4633-bf4a-ea1518531ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:00.900335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88398aa-5583-4633-bf4a-ea1518531ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:00.919217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a88398aa-5583-4633-bf4a-ea1518531ac7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:00.920669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a88398aa-5583-4633-bf4a-ea1518531ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:00.929359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 679/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:00.973249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3299628-5a6d-4cf2-8bcf-179c9a00c293 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:00.987726 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3299628-5a6d-4cf2-8bcf-179c9a00c293 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:00.996672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c94d37-0acc-4115-95d3-9ce85875d3f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:00.997345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c94d37-0acc-4115-95d3-9ce85875d3f8 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:00.997671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c94d37-0acc-4115-95d3-9ce85875d3f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:00.997945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c94d37-0acc-4115-95d3-9ce85875d3f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:01.008844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c94d37-0acc-4115-95d3-9ce85875d3f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:01.010896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c94d37-0acc-4115-95d3-9ce85875d3f8 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:01.022227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 684/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:03.595148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5eae-6a8a-4da6-bb68-c9a5979a074d None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:03.595653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5eae-6a8a-4da6-bb68-c9a5979a074d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:03.595749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc5eae-6a8a-4da6-bb68-c9a5979a074d None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:03.597086 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 680/1364] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:03.602744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec94cb6-0904-481a-94f3-501efba23c4b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:03.603125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec94cb6-0904-481a-94f3-501efba23c4b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:03.603304 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec94cb6-0904-481a-94f3-501efba23c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:03.621794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-fec94cb6-0904-481a-94f3-501efba23c4b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:03.622984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-fec94cb6-0904-481a-94f3-501efba23c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:03.632875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 685/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:03.687472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b5f3-e23a-4213-95be-5f48a9a26792 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:03.687777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b5f3-e23a-4213-95be-5f48a9a26792 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:03.688116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b5f3-e23a-4213-95be-5f48a9a26792 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:03.689592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 681/1366] 10.222.0.36 () {54 vars in 961 bytes} [Wed May 11 07:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:03.695148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d1084-c40e-40c7-8e45-1de7f99d7812 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:03.695465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d1084-c40e-40c7-8e45-1de7f99d7812 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:03.695744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d1084-c40e-40c7-8e45-1de7f99d7812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:03.713276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1a8d1084-c40e-40c7-8e45-1de7f99d7812 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:03.714478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1a8d1084-c40e-40c7-8e45-1de7f99d7812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:03.724006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 686/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Wed May 11 07:31:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:03.731682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99b5f3-e23a-4213-95be-5f48a9a26792 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:03.748958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99b5f3-e23a-4213-95be-5f48a9a26792 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:03.754600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61593a-5527-4d89-8455-ca73de5bf8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:03.755335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61593a-5527-4d89-8455-ca73de5bf8e9 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:03.755718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61593a-5527-4d89-8455-ca73de5bf8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:03.756055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61593a-5527-4d89-8455-ca73de5bf8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:03.764318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61593a-5527-4d89-8455-ca73de5bf8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:03.765936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61593a-5527-4d89-8455-ca73de5bf8e9 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:03.775170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 682/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:06.062934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fe149-cdee-4f56-8631-a9582a145b8d None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:06.063460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fe149-cdee-4f56-8631-a9582a145b8d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:06.063544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fe149-cdee-4f56-8631-a9582a145b8d None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:06.064851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 687/1369] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:06.070256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29632cb3-03a5-42a5-8f07-c30a0277e540 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:06.070686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29632cb3-03a5-42a5-8f07-c30a0277e540 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:06.070815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29632cb3-03a5-42a5-8f07-c30a0277e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:06.090135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-29632cb3-03a5-42a5-8f07-c30a0277e540 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:06.091429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-29632cb3-03a5-42a5-8f07-c30a0277e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:06.100050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 683/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:06.143777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fe149-cdee-4f56-8631-a9582a145b8d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:06.162545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fe149-cdee-4f56-8631-a9582a145b8d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:06.168453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d6302-b6fe-43e3-baba-4db9504003c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:06.169292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6302-b6fe-43e3-baba-4db9504003c6 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:06.169799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6302-b6fe-43e3-baba-4db9504003c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:06.170251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d6302-b6fe-43e3-baba-4db9504003c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:06.179597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6302-b6fe-43e3-baba-4db9504003c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:06.181654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d6302-b6fe-43e3-baba-4db9504003c6 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:06.194575 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 688/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:06.384646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f20b5-e7aa-4417-a6b3-0f9ed47bfe27 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:06.384870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f20b5-e7aa-4417-a6b3-0f9ed47bfe27 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:06.385112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f20b5-e7aa-4417-a6b3-0f9ed47bfe27 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:06.386871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 684/1372] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:06.393146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc81dcb-7968-419e-a192-ce5beb1cd4b4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:06.393807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc81dcb-7968-419e-a192-ce5beb1cd4b4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:06.394313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc81dcb-7968-419e-a192-ce5beb1cd4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:06.414885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-efc81dcb-7968-419e-a192-ce5beb1cd4b4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:06.416523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-efc81dcb-7968-419e-a192-ce5beb1cd4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:06.426889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 689/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:06.733438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8307f-90a3-43f4-a095-e189c17f9783 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:06.733438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8307f-90a3-43f4-a095-e189c17f9783 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:06.733438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8307f-90a3-43f4-a095-e189c17f9783 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:06.735102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 685/1374] 10.222.0.36 () {54 vars in 963 bytes} [Wed May 11 07:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:06.740162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94f4e9-84d5-4900-a6c7-1b67480d6653 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:06.740451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94f4e9-84d5-4900-a6c7-1b67480d6653 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:06.742446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94f4e9-84d5-4900-a6c7-1b67480d6653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:06.790604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-3e94f4e9-84d5-4900-a6c7-1b67480d6653 None None] MFA Rules not processed for user `529651ab9dd74ee1b50382d03800aea8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:06.791808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3e94f4e9-84d5-4900-a6c7-1b67480d6653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:06.853021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 690/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Wed May 11 07:31:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:06.859712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8307f-90a3-43f4-a095-e189c17f9783 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:06.870214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d8307f-90a3-43f4-a095-e189c17f9783 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:06.873896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a383f8-e864-4b1e-ade0-97cf1ad7083c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:06.874529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a383f8-e864-4b1e-ade0-97cf1ad7083c service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:06.874813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a383f8-e864-4b1e-ade0-97cf1ad7083c service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:06.875089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a383f8-e864-4b1e-ade0-97cf1ad7083c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:06.884090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a383f8-e864-4b1e-ade0-97cf1ad7083c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:06.885674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a383f8-e864-4b1e-ade0-97cf1ad7083c service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:06.897763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 686/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:08.450921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a9d1-f925-4ea3-b32d-559994c7185e None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:08.451489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a9d1-f925-4ea3-b32d-559994c7185e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:08.451489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7a9d1-f925-4ea3-b32d-559994c7185e None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:08.452874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 691/1377] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:08.459253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e9ad-a153-4165-8334-a676da347078 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:08.459765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e9ad-a153-4165-8334-a676da347078 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:08.459847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894e9ad-a153-4165-8334-a676da347078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:08.477929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f894e9ad-a153-4165-8334-a676da347078 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:08.482629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f894e9ad-a153-4165-8334-a676da347078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:08.487466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 687/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:08.532814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7a9d1-f925-4ea3-b32d-559994c7185e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:08.547284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7a9d1-f925-4ea3-b32d-559994c7185e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:08.553134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87776a99-e6db-482c-8ecc-8596874413de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:08.553816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776a99-e6db-482c-8ecc-8596874413de service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:08.554100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776a99-e6db-482c-8ecc-8596874413de service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:08.554373 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776a99-e6db-482c-8ecc-8596874413de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:08.563451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87776a99-e6db-482c-8ecc-8596874413de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:08.565064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87776a99-e6db-482c-8ecc-8596874413de service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:08.575870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 692/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:10.856842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f339d-9b54-47d1-9ef5-3815960e1813 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:10.857384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f339d-9b54-47d1-9ef5-3815960e1813 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:10.857384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f339d-9b54-47d1-9ef5-3815960e1813 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:10.858815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 688/1380] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:10.864278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ddc4-5a80-4ea1-b2b3-f14df280dbd1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:10.864712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ddc4-5a80-4ea1-b2b3-f14df280dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:10.864832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ddc4-5a80-4ea1-b2b3-f14df280dbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:10.882526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8dd2ddc4-5a80-4ea1-b2b3-f14df280dbd1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:10.883703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8dd2ddc4-5a80-4ea1-b2b3-f14df280dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:10.891837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 693/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:10.937386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f339d-9b54-47d1-9ef5-3815960e1813 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:10.952754 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f339d-9b54-47d1-9ef5-3815960e1813 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:10.958841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52c26b-34c4-48ab-b388-8ba255fcc1ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:10.959597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c26b-34c4-48ab-b388-8ba255fcc1ac service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:10.959985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c26b-34c4-48ab-b388-8ba255fcc1ac service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:10.960362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c26b-34c4-48ab-b388-8ba255fcc1ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:10.968904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52c26b-34c4-48ab-b388-8ba255fcc1ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:10.970629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52c26b-34c4-48ab-b388-8ba255fcc1ac service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:10.981012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 689/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:31:13.226729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10770-a7f3-41bc-a862-1fe8d28fdaa5 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:13.227816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10770-a7f3-41bc-a862-1fe8d28fdaa5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:13.228250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10770-a7f3-41bc-a862-1fe8d28fdaa5 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:13.235199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b016ba-8aca-4b2c-8e53-ce26b98aa8c8 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:13.236017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b016ba-8aca-4b2c-8e53-ce26b98aa8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:13.236463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b016ba-8aca-4b2c-8e53-ce26b98aa8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:13.238637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 694/1383] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:13.264543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-59b016ba-8aca-4b2c-8e53-ce26b98aa8c8 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:13.265749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-59b016ba-8aca-4b2c-8e53-ce26b98aa8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:13.274386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 690/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:31:13.315996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d10770-a7f3-41bc-a862-1fe8d28fdaa5 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:13.330157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d10770-a7f3-41bc-a862-1fe8d28fdaa5 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:13.335578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c2e27-f50c-4ded-bbb9-6949102eb695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:13.336235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c2e27-f50c-4ded-bbb9-6949102eb695 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:13.336520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c2e27-f50c-4ded-bbb9-6949102eb695 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:13.337089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c2e27-f50c-4ded-bbb9-6949102eb695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:13.346194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c2e27-f50c-4ded-bbb9-6949102eb695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:13.348555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c2e27-f50c-4ded-bbb9-6949102eb695 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:13.366242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 695/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:15.802522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba4a16-f9cf-4d2d-abed-a4097a175c0a None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:15.803137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba4a16-f9cf-4d2d-abed-a4097a175c0a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:15.803137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba4a16-f9cf-4d2d-abed-a4097a175c0a None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:15.804455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 691/1386] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:15.811845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82c17-1a0c-4b74-9126-b2f623768e3b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:15.812291 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82c17-1a0c-4b74-9126-b2f623768e3b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:15.812544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82c17-1a0c-4b74-9126-b2f623768e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:15.830713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9ed82c17-1a0c-4b74-9126-b2f623768e3b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:15.832797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9ed82c17-1a0c-4b74-9126-b2f623768e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:15.843752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 696/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:15.889709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba4a16-f9cf-4d2d-abed-a4097a175c0a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:15.907483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba4a16-f9cf-4d2d-abed-a4097a175c0a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:15.914291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d91a4b-2153-45bc-8cae-812b3e794a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:15.915166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91a4b-2153-45bc-8cae-812b3e794a59 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:15.915533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91a4b-2153-45bc-8cae-812b3e794a59 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:15.915884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d91a4b-2153-45bc-8cae-812b3e794a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:15.927957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d91a4b-2153-45bc-8cae-812b3e794a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:15.930026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d91a4b-2153-45bc-8cae-812b3e794a59 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:15.942695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 692/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:18.516652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded8785-a959-4013-8e61-9a5da27587d4 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:18.517146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded8785-a959-4013-8e61-9a5da27587d4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:18.517259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded8785-a959-4013-8e61-9a5da27587d4 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:18.518697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 697/1389] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:18.524513 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888ce45-cde3-4e8e-b5f5-da3f86900f16 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:18.524969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888ce45-cde3-4e8e-b5f5-da3f86900f16 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:18.525326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888ce45-cde3-4e8e-b5f5-da3f86900f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:18.547102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4888ce45-cde3-4e8e-b5f5-da3f86900f16 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:18.548649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4888ce45-cde3-4e8e-b5f5-da3f86900f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:18.558979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 693/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:18.602673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded8785-a959-4013-8e61-9a5da27587d4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:18.617285 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded8785-a959-4013-8e61-9a5da27587d4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:18.624028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ae0e-90e4-4b93-adbf-c3f9cb9a7575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:18.625062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ae0e-90e4-4b93-adbf-c3f9cb9a7575 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:18.625441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ae0e-90e4-4b93-adbf-c3f9cb9a7575 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:18.625798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ae0e-90e4-4b93-adbf-c3f9cb9a7575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:18.636667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ae0e-90e4-4b93-adbf-c3f9cb9a7575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:18.638750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ae0e-90e4-4b93-adbf-c3f9cb9a7575 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:18.650999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 698/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:20.908294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f732d1-e984-43c9-b5d1-8d252008b172 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:20.908848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f732d1-e984-43c9-b5d1-8d252008b172 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:20.908848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f732d1-e984-43c9-b5d1-8d252008b172 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:20.910305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 694/1392] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:20.915645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535534-f997-4d03-a6a7-5227ca8044f2 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:20.916057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535534-f997-4d03-a6a7-5227ca8044f2 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:20.916227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc535534-f997-4d03-a6a7-5227ca8044f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:20.933260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-dc535534-f997-4d03-a6a7-5227ca8044f2 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:20.934564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-dc535534-f997-4d03-a6a7-5227ca8044f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:20.943129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 699/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:20.986320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f732d1-e984-43c9-b5d1-8d252008b172 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:21.000228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f732d1-e984-43c9-b5d1-8d252008b172 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:21.006138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc180eb5-0d7f-4ffb-aaf5-3651077b96b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:21.006774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc180eb5-0d7f-4ffb-aaf5-3651077b96b3 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:21.007062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc180eb5-0d7f-4ffb-aaf5-3651077b96b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:21.007335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc180eb5-0d7f-4ffb-aaf5-3651077b96b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:21.015844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc180eb5-0d7f-4ffb-aaf5-3651077b96b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:21.017418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc180eb5-0d7f-4ffb-aaf5-3651077b96b3 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:21.027084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 695/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:22.713649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f871e-5a51-4b08-90af-4953ed657f9b None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:22.714201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f871e-5a51-4b08-90af-4953ed657f9b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:22.714201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f871e-5a51-4b08-90af-4953ed657f9b None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:22.715606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 700/1395] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:22.720951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5624-becf-490e-b3c3-edd37e589220 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:22.721381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5624-becf-490e-b3c3-edd37e589220 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:22.721582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5624-becf-490e-b3c3-edd37e589220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:22.740861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-137f5624-becf-490e-b3c3-edd37e589220 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:22.742047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-137f5624-becf-490e-b3c3-edd37e589220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:22.750114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 696/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:22.805521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30ab3-c7d6-41b4-b985-8763d09d9a68 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:22.805852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30ab3-c7d6-41b4-b985-8763d09d9a68 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:22.806130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e30ab3-c7d6-41b4-b985-8763d09d9a68 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:22.807472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 701/1397] 10.222.0.36 () {54 vars in 962 bytes} [Wed May 11 07:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:22.812644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457e59d-88f7-4a2f-97fb-fffa59d96ea1 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:22.812940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457e59d-88f7-4a2f-97fb-fffa59d96ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:22.813225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457e59d-88f7-4a2f-97fb-fffa59d96ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:22.860093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b457e59d-88f7-4a2f-97fb-fffa59d96ea1 None None] MFA Rules not processed for user `91feeca74fe749fba52423aa28d48916`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:22.861286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b457e59d-88f7-4a2f-97fb-fffa59d96ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:22.919549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 697/1398] 10.222.0.36 () {58 vars in 1059 bytes} [Wed May 11 07:31:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:22.927541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30ab3-c7d6-41b4-b985-8763d09d9a68 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:22.938208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e30ab3-c7d6-41b4-b985-8763d09d9a68 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:22.942315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82696f79-6f8e-4801-8238-595fa4770226 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91feeca74fe749fba52423aa28d48916', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:22.942954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82696f79-6f8e-4801-8238-595fa4770226 service glance] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:22.943237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82696f79-6f8e-4801-8238-595fa4770226 service glance] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:22.943515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82696f79-6f8e-4801-8238-595fa4770226 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:22.952141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82696f79-6f8e-4801-8238-595fa4770226 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:22.953601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82696f79-6f8e-4801-8238-595fa4770226 service glance] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:22.962730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 702/1399] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:23.266895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1c7-c8ba-4c5c-9dd3-417f664712ef None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:23.267190 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1c7-c8ba-4c5c-9dd3-417f664712ef None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:23.267470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1c7-c8ba-4c5c-9dd3-417f664712ef None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:23.268847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 698/1400] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:23.274196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7642a7-54db-49b5-9227-b77d2356275f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:23.274480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7642a7-54db-49b5-9227-b77d2356275f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:23.274753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7642a7-54db-49b5-9227-b77d2356275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:23.292523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ea7642a7-54db-49b5-9227-b77d2356275f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:23.293795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ea7642a7-54db-49b5-9227-b77d2356275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:23.302111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 703/1401] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:23.346526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c1c7-c8ba-4c5c-9dd3-417f664712ef None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:23.365877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c1c7-c8ba-4c5c-9dd3-417f664712ef None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:23.371917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fab1a9-47b5-409f-86be-db8268790dad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:23.372801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fab1a9-47b5-409f-86be-db8268790dad service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:23.373237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fab1a9-47b5-409f-86be-db8268790dad service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:23.373740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fab1a9-47b5-409f-86be-db8268790dad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:23.381159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3dc8a-a09f-42bd-8f1d-b98a9ebc3009 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:23.381441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3dc8a-a09f-42bd-8f1d-b98a9ebc3009 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:23.381933 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3dc8a-a09f-42bd-8f1d-b98a9ebc3009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:23.384271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fab1a9-47b5-409f-86be-db8268790dad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:23.385937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fab1a9-47b5-409f-86be-db8268790dad service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:23.395423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 699/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:23.429003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e1c3dc8a-a09f-42bd-8f1d-b98a9ebc3009 None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:23.430338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e1c3dc8a-a09f-42bd-8f1d-b98a9ebc3009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:23.500314 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 704/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:31:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:23.543570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667a8c-32f6-4671-bdfb-b62fab6d4c31 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:23.543862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667a8c-32f6-4671-bdfb-b62fab6d4c31 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:23.544209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667a8c-32f6-4671-bdfb-b62fab6d4c31 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:23.545782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 700/1404] 10.222.0.36 () {54 vars in 942 bytes} [Wed May 11 07:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:23.553793 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec987-3132-44ec-b3b5-6d6c3fe78df4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:23.554089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec987-3132-44ec-b3b5-6d6c3fe78df4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:23.554397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec987-3132-44ec-b3b5-6d6c3fe78df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:23.605396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-cc1ec987-3132-44ec-b3b5-6d6c3fe78df4 None None] MFA Rules not processed for user `0aa4d2cc79404c2c8fbc1ff8868b386a`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:23.606643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cc1ec987-3132-44ec-b3b5-6d6c3fe78df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:23.677855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 705/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Wed May 11 07:31:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:23.687392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667a8c-32f6-4671-bdfb-b62fab6d4c31 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:23.700825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667a8c-32f6-4671-bdfb-b62fab6d4c31 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:23.705645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d1dd2-0b4d-41d5-896d-81a2521ddb9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:23.706274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d1dd2-0b4d-41d5-896d-81a2521ddb9f service swift] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:23.706553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d1dd2-0b4d-41d5-896d-81a2521ddb9f service swift] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:23.706900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d1dd2-0b4d-41d5-896d-81a2521ddb9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:23.714810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d1dd2-0b4d-41d5-896d-81a2521ddb9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:23.716383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d1dd2-0b4d-41d5-896d-81a2521ddb9f service swift] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:23.724854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 701/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:31:25.677034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e11de-ce27-4c13-8c9a-d22fc617345d None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:25.677759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e11de-ce27-4c13-8c9a-d22fc617345d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:25.677759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e11de-ce27-4c13-8c9a-d22fc617345d None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:25.679026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 706/1407] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:25.684314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c646-4ef9-47b3-84fd-a7c61a340b7f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:25.684729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c646-4ef9-47b3-84fd-a7c61a340b7f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:25.684875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c646-4ef9-47b3-84fd-a7c61a340b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:25.703068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-79a5c646-4ef9-47b3-84fd-a7c61a340b7f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:25.704275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-79a5c646-4ef9-47b3-84fd-a7c61a340b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:25.713220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 702/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:25.757044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e11de-ce27-4c13-8c9a-d22fc617345d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:25.772713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e11de-ce27-4c13-8c9a-d22fc617345d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:25.778689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26b04c-7938-4401-857e-3c199f82ba90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:25.779344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26b04c-7938-4401-857e-3c199f82ba90 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:25.779631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26b04c-7938-4401-857e-3c199f82ba90 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:25.779905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26b04c-7938-4401-857e-3c199f82ba90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:25.789699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26b04c-7938-4401-857e-3c199f82ba90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:25.791310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26b04c-7938-4401-857e-3c199f82ba90 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:25.801125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 707/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:47.138580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1d85-4f6a-4760-a556-d8a46b076b18 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:47.139236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1d85-4f6a-4760-a556-d8a46b076b18 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:47.139236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1d85-4f6a-4760-a556-d8a46b076b18 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:47.140512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 703/1410] 10.222.0.36 () {54 vars in 918 bytes} [Wed May 11 07:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:47.147135 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3156-6091-4539-a5c4-6810317eea76 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:47.147637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3156-6091-4539-a5c4-6810317eea76 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:47.147744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3156-6091-4539-a5c4-6810317eea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:47.165932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d72b3156-6091-4539-a5c4-6810317eea76 None None] MFA Rules not processed for user `a1b36840995045199ec96eac939d5d35`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:47.167146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d72b3156-6091-4539-a5c4-6810317eea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:47.176112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 708/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Wed May 11 07:31:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:31:47.190638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47da7-8cd4-4d17-99a1-1aac6f3b1794 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:47.190969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47da7-8cd4-4d17-99a1-1aac6f3b1794 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:47.191249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47da7-8cd4-4d17-99a1-1aac6f3b1794 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:47.192652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 704/1412] 10.222.0.36 () {54 vars in 918 bytes} [Wed May 11 07:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:47.197283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65a17-b3c6-4562-8cef-af0d3b27dd49 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:47.197627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65a17-b3c6-4562-8cef-af0d3b27dd49 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:47.197904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd65a17-b3c6-4562-8cef-af0d3b27dd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:47.215033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-5bd65a17-b3c6-4562-8cef-af0d3b27dd49 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:47.216212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5bd65a17-b3c6-4562-8cef-af0d3b27dd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:47.225655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 709/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Wed May 11 07:31:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:31:49.929701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a6104-dea1-4b92-84fe-dbec24316bc2 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:49.930368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a6104-dea1-4b92-84fe-dbec24316bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:49.930368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a6104-dea1-4b92-84fe-dbec24316bc2 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:49.931640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:49.936944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034e5f-eae0-4b5a-a111-4099ad58984b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:49.937613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034e5f-eae0-4b5a-a111-4099ad58984b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:49.937796 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034e5f-eae0-4b5a-a111-4099ad58984b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:49.955239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a2034e5f-eae0-4b5a-a111-4099ad58984b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:49.956429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a2034e5f-eae0-4b5a-a111-4099ad58984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:49.964088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:50.005277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a6104-dea1-4b92-84fe-dbec24316bc2 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:50.019023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a6104-dea1-4b92-84fe-dbec24316bc2 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:50.024251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2e28-6ae4-4d9e-ac39-fcc739b4c3aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:50.024874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2e28-6ae4-4d9e-ac39-fcc739b4c3aa service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:50.025156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2e28-6ae4-4d9e-ac39-fcc739b4c3aa service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:50.025430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2e28-6ae4-4d9e-ac39-fcc739b4c3aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:50.033169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2e28-6ae4-4d9e-ac39-fcc739b4c3aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:50.035326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2e28-6ae4-4d9e-ac39-fcc739b4c3aa service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:50.044235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 706/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:51.019683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cbba2-f83c-41b0-ab1b-8c85ab775f91 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:51.020270 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cbba2-f83c-41b0-ab1b-8c85ab775f91 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:51.020270 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cbba2-f83c-41b0-ab1b-8c85ab775f91 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:51.021596 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:51.026404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f09c3-d720-4efa-8600-485a7846af34 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:51.026795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f09c3-d720-4efa-8600-485a7846af34 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:51.026969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f09c3-d720-4efa-8600-485a7846af34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:51.044278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-9b4f09c3-d720-4efa-8600-485a7846af34 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:51.045458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9b4f09c3-d720-4efa-8600-485a7846af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:51.054507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:51.206071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cbba2-f83c-41b0-ab1b-8c85ab775f91 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:51.220241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cbba2-f83c-41b0-ab1b-8c85ab775f91 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:51.225649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576f049-c023-4044-ba36-cd46a4571f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:51.226279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f049-c023-4044-ba36-cd46a4571f2a service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:51.226562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f049-c023-4044-ba36-cd46a4571f2a service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:51.226837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576f049-c023-4044-ba36-cd46a4571f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:51.234691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576f049-c023-4044-ba36-cd46a4571f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:51.236294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576f049-c023-4044-ba36-cd46a4571f2a service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:51.245936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 712/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:52.197092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99850-4896-4821-a1ba-a0769234697e None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:52.197691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99850-4896-4821-a1ba-a0769234697e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:52.197691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99850-4896-4821-a1ba-a0769234697e None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:52.199052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:52.204278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0569c-dcd6-4243-8c51-87dd6023b69d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:52.204665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0569c-dcd6-4243-8c51-87dd6023b69d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:52.204832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0569c-dcd6-4243-8c51-87dd6023b69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:52.223446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-17d0569c-dcd6-4243-8c51-87dd6023b69d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:52.224641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-17d0569c-dcd6-4243-8c51-87dd6023b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:52.232375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:52.380624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99850-4896-4821-a1ba-a0769234697e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:52.395168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99850-4896-4821-a1ba-a0769234697e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:52.400460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe17fe5-63fc-414d-992e-45033367d106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:52.401090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17fe5-63fc-414d-992e-45033367d106 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:52.401377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17fe5-63fc-414d-992e-45033367d106 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:52.401694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17fe5-63fc-414d-992e-45033367d106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:52.409522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe17fe5-63fc-414d-992e-45033367d106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:52.411121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe17fe5-63fc-414d-992e-45033367d106 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:52.420245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 709/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:53.340850 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623b5fb-e461-43aa-955c-8e05074b75fb None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:53.341373 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623b5fb-e461-43aa-955c-8e05074b75fb None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:53.341373 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623b5fb-e461-43aa-955c-8e05074b75fb None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:53.342701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:53.348455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc4fa-f260-40ee-aec0-678cbd172666 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:53.348912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc4fa-f260-40ee-aec0-678cbd172666 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:53.349018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc4fa-f260-40ee-aec0-678cbd172666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:53.366549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a71bc4fa-f260-40ee-aec0-678cbd172666 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:53.367723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a71bc4fa-f260-40ee-aec0-678cbd172666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:53.375271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:53.522881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623b5fb-e461-43aa-955c-8e05074b75fb None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:53.537161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623b5fb-e461-43aa-955c-8e05074b75fb None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:53.542477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0287c14-a57f-43dc-a757-f88dc68e30fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:53.543095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0287c14-a57f-43dc-a757-f88dc68e30fb service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:53.543376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0287c14-a57f-43dc-a757-f88dc68e30fb service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:53.543650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0287c14-a57f-43dc-a757-f88dc68e30fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:53.551385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0287c14-a57f-43dc-a757-f88dc68e30fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:53.552949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0287c14-a57f-43dc-a757-f88dc68e30fb service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:53.562026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 715/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:54.474633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8fafd-f265-4f3a-a738-12c3f652d033 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:54.475206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8fafd-f265-4f3a-a738-12c3f652d033 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:54.475206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8fafd-f265-4f3a-a738-12c3f652d033 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:54.476601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:54.481511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28a480-298d-4d70-9e61-4acd0f5adf68 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:54.481922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28a480-298d-4d70-9e61-4acd0f5adf68 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:54.482091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28a480-298d-4d70-9e61-4acd0f5adf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:54.499297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ce28a480-298d-4d70-9e61-4acd0f5adf68 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:54.500489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ce28a480-298d-4d70-9e61-4acd0f5adf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:54.508620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:54.655783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8fafd-f265-4f3a-a738-12c3f652d033 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:54.669659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8fafd-f265-4f3a-a738-12c3f652d033 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:54.674896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b58dbd-8885-462d-8c1c-70dacd63a0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:54.675564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58dbd-8885-462d-8c1c-70dacd63a0eb service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:54.675846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58dbd-8885-462d-8c1c-70dacd63a0eb service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:54.676118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58dbd-8885-462d-8c1c-70dacd63a0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:54.683912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b58dbd-8885-462d-8c1c-70dacd63a0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:54.685492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b58dbd-8885-462d-8c1c-70dacd63a0eb service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:54.695332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 712/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:55.561511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcc7fb-8c48-411f-9929-20bb5b31161f None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:55.562064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcc7fb-8c48-411f-9929-20bb5b31161f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:55.562177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcc7fb-8c48-411f-9929-20bb5b31161f None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:55.563729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:55.568613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d6435-c4b9-4c7f-8f93-34816e264f9f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:55.569043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d6435-c4b9-4c7f-8f93-34816e264f9f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:55.569208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d6435-c4b9-4c7f-8f93-34816e264f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:55.587292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-659d6435-c4b9-4c7f-8f93-34816e264f9f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:55.588488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-659d6435-c4b9-4c7f-8f93-34816e264f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:55.596187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:55.744689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcc7fb-8c48-411f-9929-20bb5b31161f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:55.758579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcc7fb-8c48-411f-9929-20bb5b31161f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:55.763865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c521843-9435-4751-bbbd-d5183f92b677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:55.764494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521843-9435-4751-bbbd-d5183f92b677 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:55.764781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521843-9435-4751-bbbd-d5183f92b677 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:55.765059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521843-9435-4751-bbbd-d5183f92b677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:55.773514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c521843-9435-4751-bbbd-d5183f92b677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:55.775154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c521843-9435-4751-bbbd-d5183f92b677 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:55.784436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 718/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:56.666275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ed975-846a-4df1-842d-2c2b3bc75feb None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:56.666839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ed975-846a-4df1-842d-2c2b3bc75feb None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:56.666839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ed975-846a-4df1-842d-2c2b3bc75feb None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:56.668230 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:56.673090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490cdc-89c5-4c47-b060-da09daa91e7a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:56.673516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490cdc-89c5-4c47-b060-da09daa91e7a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:56.673673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14490cdc-89c5-4c47-b060-da09daa91e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:56.692746 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-14490cdc-89c5-4c47-b060-da09daa91e7a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:56.693964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-14490cdc-89c5-4c47-b060-da09daa91e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:56.701698 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:56.849799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ed975-846a-4df1-842d-2c2b3bc75feb None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:56.864745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ed975-846a-4df1-842d-2c2b3bc75feb None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:56.870104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4a299-0e66-4abf-baff-872e8d9a3378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:56.870740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a299-0e66-4abf-baff-872e8d9a3378 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:56.871022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a299-0e66-4abf-baff-872e8d9a3378 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:56.871315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4a299-0e66-4abf-baff-872e8d9a3378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:56.879131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a299-0e66-4abf-baff-872e8d9a3378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:56.880705 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4a299-0e66-4abf-baff-872e8d9a3378 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:56.889798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 715/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:57.760089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f8cb-cea5-407c-bf6a-cec30fcb334d None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:57.760648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f8cb-cea5-407c-bf6a-cec30fcb334d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:57.760775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f8cb-cea5-407c-bf6a-cec30fcb334d None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:57.762102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:57.767002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b28e-c119-4afe-843a-e402ba8c4d87 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:57.767434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b28e-c119-4afe-843a-e402ba8c4d87 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:57.767557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b28e-c119-4afe-843a-e402ba8c4d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:57.786652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b102b28e-c119-4afe-843a-e402ba8c4d87 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:57.787826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b102b28e-c119-4afe-843a-e402ba8c4d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:57.795417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:57.947824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18f8cb-cea5-407c-bf6a-cec30fcb334d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:57.961717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18f8cb-cea5-407c-bf6a-cec30fcb334d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:57.967156 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7df21-9236-4940-beb7-d8ab9b2c4f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:57.967787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7df21-9236-4940-beb7-d8ab9b2c4f49 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:57.968075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7df21-9236-4940-beb7-d8ab9b2c4f49 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:57.968354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7df21-9236-4940-beb7-d8ab9b2c4f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:57.976323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7df21-9236-4940-beb7-d8ab9b2c4f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:57.977948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7df21-9236-4940-beb7-d8ab9b2c4f49 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:57.987017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 721/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:31:58.855852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a6ec-21b9-4fbb-ae6c-7c42b0dc78d2 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:58.856424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a6ec-21b9-4fbb-ae6c-7c42b0dc78d2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:58.856424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894a6ec-21b9-4fbb-ae6c-7c42b0dc78d2 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:58.857887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:31:58.862660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a58c-fa35-46fc-a5b7-54d693da3b84 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:58.863103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a58c-fa35-46fc-a5b7-54d693da3b84 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:58.863260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5a58c-fa35-46fc-a5b7-54d693da3b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:58.880654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-86a5a58c-fa35-46fc-a5b7-54d693da3b84 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:31:58.881866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-86a5a58c-fa35-46fc-a5b7-54d693da3b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:31:58.889497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:31:59.037445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894a6ec-21b9-4fbb-ae6c-7c42b0dc78d2 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:31:59.051238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894a6ec-21b9-4fbb-ae6c-7c42b0dc78d2 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:31:59.056451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cb0d8-40c2-4c14-9355-47623b5a0483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:31:59.057079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb0d8-40c2-4c14-9355-47623b5a0483 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:31:59.057357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb0d8-40c2-4c14-9355-47623b5a0483 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:31:59.057660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb0d8-40c2-4c14-9355-47623b5a0483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:31:59.065654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cb0d8-40c2-4c14-9355-47623b5a0483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:31:59.067772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cb0d8-40c2-4c14-9355-47623b5a0483 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:31:59.076679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 718/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:01.191052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f1de-ec53-479d-85ca-c9be6b62f8c6 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:01.192094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f1de-ec53-479d-85ca-c9be6b62f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:01.192094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f1de-ec53-479d-85ca-c9be6b62f8c6 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:01.193522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:01.198909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4480-d429-4973-a08e-772b0748c755 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:01.199341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4480-d429-4973-a08e-772b0748c755 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:01.199454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4480-d429-4973-a08e-772b0748c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:01.217248 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8acf4480-d429-4973-a08e-772b0748c755 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:01.218464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8acf4480-d429-4973-a08e-772b0748c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:01.226078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:01.263195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06f1de-ec53-479d-85ca-c9be6b62f8c6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:01.264854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-be06f1de-ec53-479d-85ca-c9be6b62f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:01.278191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06f1de-ec53-479d-85ca-c9be6b62f8c6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:01.281767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b3761-2978-457d-8e3b-77212fc9c703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:01.282807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3761-2978-457d-8e3b-77212fc9c703 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:01.283290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3761-2978-457d-8e3b-77212fc9c703 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:01.283774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3761-2978-457d-8e3b-77212fc9c703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:01.296622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b3761-2978-457d-8e3b-77212fc9c703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:01.298109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b3761-2978-457d-8e3b-77212fc9c703 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:01.307556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 724/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:03.675671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f3e3-4ca7-4637-a2de-acaed346c054 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:03.676819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f3e3-4ca7-4637-a2de-acaed346c054 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:03.676819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47f3e3-4ca7-4637-a2de-acaed346c054 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:03.678207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:03.683485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c225f3-2253-4378-9503-4f9e56d983ba None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:03.683917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c225f3-2253-4378-9503-4f9e56d983ba None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:03.684022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c225f3-2253-4378-9503-4f9e56d983ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:03.701332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-43c225f3-2253-4378-9503-4f9e56d983ba None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:03.702539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-43c225f3-2253-4378-9503-4f9e56d983ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:03.710288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:03.747949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47f3e3-4ca7-4637-a2de-acaed346c054 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:03.758554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47f3e3-4ca7-4637-a2de-acaed346c054 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:03.761953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014edb8-3e64-41d2-ae3e-fcf7082c7880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:03.762579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014edb8-3e64-41d2-ae3e-fcf7082c7880 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:03.762855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014edb8-3e64-41d2-ae3e-fcf7082c7880 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:03.763124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014edb8-3e64-41d2-ae3e-fcf7082c7880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:03.771609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014edb8-3e64-41d2-ae3e-fcf7082c7880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:03.773022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014edb8-3e64-41d2-ae3e-fcf7082c7880 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:03.782251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 721/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:06.322083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d706bb9-3ea0-4d9d-a1fb-2ed433584320 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:06.322660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d706bb9-3ea0-4d9d-a1fb-2ed433584320 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:06.322660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d706bb9-3ea0-4d9d-a1fb-2ed433584320 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:06.324032 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:06.329309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111583c9-042f-4243-809e-faea1d75fed9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:06.329745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111583c9-042f-4243-809e-faea1d75fed9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:06.329904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111583c9-042f-4243-809e-faea1d75fed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:06.347064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-111583c9-042f-4243-809e-faea1d75fed9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:06.348285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-111583c9-042f-4243-809e-faea1d75fed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:06.356109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:06.394837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d706bb9-3ea0-4d9d-a1fb-2ed433584320 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:06.404992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d706bb9-3ea0-4d9d-a1fb-2ed433584320 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:06.408567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880db0-e88d-4377-8e6b-160d136b2fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:06.409205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880db0-e88d-4377-8e6b-160d136b2fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:06.409495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880db0-e88d-4377-8e6b-160d136b2fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:06.409807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880db0-e88d-4377-8e6b-160d136b2fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:06.418818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98880db0-e88d-4377-8e6b-160d136b2fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:06.420264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98880db0-e88d-4377-8e6b-160d136b2fe6 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:06.429974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 727/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:08.749868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13d09-5c8c-4974-a94f-263a0795e6fc None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:08.750426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13d09-5c8c-4974-a94f-263a0795e6fc None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:08.750426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13d09-5c8c-4974-a94f-263a0795e6fc None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:08.751729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:08.757438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583052d2-3694-4a7c-b7e5-7f7e3aa48757 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:08.757926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583052d2-3694-4a7c-b7e5-7f7e3aa48757 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:08.758035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583052d2-3694-4a7c-b7e5-7f7e3aa48757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:08.775789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-583052d2-3694-4a7c-b7e5-7f7e3aa48757 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:08.776972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-583052d2-3694-4a7c-b7e5-7f7e3aa48757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:08.784542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:08.822218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13d09-5c8c-4974-a94f-263a0795e6fc None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:08.833402 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13d09-5c8c-4974-a94f-263a0795e6fc None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:08.837112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08139ee0-3218-407c-83c9-00d76f619d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:08.837772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139ee0-3218-407c-83c9-00d76f619d66 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:08.838055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139ee0-3218-407c-83c9-00d76f619d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:08.838329 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08139ee0-3218-407c-83c9-00d76f619d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:08.846980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08139ee0-3218-407c-83c9-00d76f619d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:08.848399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08139ee0-3218-407c-83c9-00d76f619d66 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:08.857368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 724/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:11.107528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fab2bc-f95d-4d73-aa70-6d0498f039cd None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:11.108096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fab2bc-f95d-4d73-aa70-6d0498f039cd None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:11.108096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fab2bc-f95d-4d73-aa70-6d0498f039cd None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:11.109439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:11.115414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2bff3-0f2d-4708-9fd6-f99323bcef56 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:11.115811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2bff3-0f2d-4708-9fd6-f99323bcef56 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:11.115987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2bff3-0f2d-4708-9fd6-f99323bcef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:11.133109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-21e2bff3-0f2d-4708-9fd6-f99323bcef56 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:11.134337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-21e2bff3-0f2d-4708-9fd6-f99323bcef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:11.142056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:32:11.179676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fab2bc-f95d-4d73-aa70-6d0498f039cd None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:11.190248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fab2bc-f95d-4d73-aa70-6d0498f039cd None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:11.193759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55caa85-8a34-4a6b-a0e9-cc9d49296e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:11.194387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55caa85-8a34-4a6b-a0e9-cc9d49296e13 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:11.194671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55caa85-8a34-4a6b-a0e9-cc9d49296e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:11.194947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55caa85-8a34-4a6b-a0e9-cc9d49296e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:11.203439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55caa85-8a34-4a6b-a0e9-cc9d49296e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:11.204856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55caa85-8a34-4a6b-a0e9-cc9d49296e13 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:11.215072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 730/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:13.491712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92427f9d-30e1-464b-989f-cdb681aac100 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:13.492195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92427f9d-30e1-464b-989f-cdb681aac100 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:13.492291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92427f9d-30e1-464b-989f-cdb681aac100 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:13.493657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:13.498989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28c7d-3a72-47b1-ab97-ca85f31cd957 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:13.499434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28c7d-3a72-47b1-ab97-ca85f31cd957 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:13.499542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28c7d-3a72-47b1-ab97-ca85f31cd957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:13.517370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6ce28c7d-3a72-47b1-ab97-ca85f31cd957 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:13.518610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6ce28c7d-3a72-47b1-ab97-ca85f31cd957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:13.526867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:32:13.563631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92427f9d-30e1-464b-989f-cdb681aac100 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:13.574488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92427f9d-30e1-464b-989f-cdb681aac100 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:13.577911 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea61d3-2e13-4351-8794-816646786389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:13.578536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea61d3-2e13-4351-8794-816646786389 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:13.578817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea61d3-2e13-4351-8794-816646786389 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:13.579090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea61d3-2e13-4351-8794-816646786389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:13.588202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea61d3-2e13-4351-8794-816646786389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:13.589651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea61d3-2e13-4351-8794-816646786389 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:13.598636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 727/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:15.817562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a3e3-8f72-4974-9007-6894a749c0dc None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:15.818146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a3e3-8f72-4974-9007-6894a749c0dc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:15.818146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a3e3-8f72-4974-9007-6894a749c0dc None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:15.819474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:15.824707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef91220-f7fe-4132-ab87-d72a7fd8123b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:15.825105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef91220-f7fe-4132-ab87-d72a7fd8123b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:15.825261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef91220-f7fe-4132-ab87-d72a7fd8123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:15.842743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-6ef91220-f7fe-4132-ab87-d72a7fd8123b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:15.843910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-6ef91220-f7fe-4132-ab87-d72a7fd8123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:15.851425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:15.888100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a3e3-8f72-4974-9007-6894a749c0dc None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:15.898938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a3e3-8f72-4974-9007-6894a749c0dc None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:15.902593 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91d3ca-61b0-470a-a0a2-f5e0a100b024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:15.903218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d3ca-61b0-470a-a0a2-f5e0a100b024 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:15.903502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d3ca-61b0-470a-a0a2-f5e0a100b024 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:15.903778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d3ca-61b0-470a-a0a2-f5e0a100b024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:15.912390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91d3ca-61b0-470a-a0a2-f5e0a100b024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:15.913838 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91d3ca-61b0-470a-a0a2-f5e0a100b024 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:15.922927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 733/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:18.189813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616486f-525d-4afc-a4fb-250d3ba9cafd None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:18.190374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616486f-525d-4afc-a4fb-250d3ba9cafd None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:18.190374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616486f-525d-4afc-a4fb-250d3ba9cafd None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:18.192308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:18.197600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0e8c6-45b5-4e4f-bf95-ea419a097380 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:18.198058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0e8c6-45b5-4e4f-bf95-ea419a097380 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:18.198208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0e8c6-45b5-4e4f-bf95-ea419a097380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:18.215381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-63d0e8c6-45b5-4e4f-bf95-ea419a097380 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:18.216576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-63d0e8c6-45b5-4e4f-bf95-ea419a097380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:18.224912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:18.261778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616486f-525d-4afc-a4fb-250d3ba9cafd None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:18.272171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616486f-525d-4afc-a4fb-250d3ba9cafd None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:18.275648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc8d9-460d-41df-8558-c143cce1706e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:18.276279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc8d9-460d-41df-8558-c143cce1706e service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:18.276565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc8d9-460d-41df-8558-c143cce1706e service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:18.276845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc8d9-460d-41df-8558-c143cce1706e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:18.285824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccc8d9-460d-41df-8558-c143cce1706e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:18.287252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccc8d9-460d-41df-8558-c143cce1706e service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:18.296367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 730/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:20.567868 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0df530-3e61-4ceb-bcf4-60a74992be60 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:20.568404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0df530-3e61-4ceb-bcf4-60a74992be60 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:20.568404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0df530-3e61-4ceb-bcf4-60a74992be60 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:20.569788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:20.574962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb1f4e-cb23-425a-be9a-bfcc24e11db0 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:20.575380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb1f4e-cb23-425a-be9a-bfcc24e11db0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:20.575523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb1f4e-cb23-425a-be9a-bfcc24e11db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:20.592539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-75fb1f4e-cb23-425a-be9a-bfcc24e11db0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:20.593777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-75fb1f4e-cb23-425a-be9a-bfcc24e11db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:20.601393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:20.638377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0df530-3e61-4ceb-bcf4-60a74992be60 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:20.649108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0df530-3e61-4ceb-bcf4-60a74992be60 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:20.652704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f685397-986d-4368-9357-201219be92a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:20.653337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f685397-986d-4368-9357-201219be92a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:20.653646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f685397-986d-4368-9357-201219be92a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:20.654140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f685397-986d-4368-9357-201219be92a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:20.663057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f685397-986d-4368-9357-201219be92a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:20.664547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f685397-986d-4368-9357-201219be92a2 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:20.673533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 736/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:22.866411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea283-0b1d-4a6a-aa08-ad8fab3df346 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:22.866935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea283-0b1d-4a6a-aa08-ad8fab3df346 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:22.866935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea283-0b1d-4a6a-aa08-ad8fab3df346 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:22.868271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:22.873649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99193-024f-448e-9fc6-d7625edc6382 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:22.874072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99193-024f-448e-9fc6-d7625edc6382 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:22.874201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def99193-024f-448e-9fc6-d7625edc6382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:22.891863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-def99193-024f-448e-9fc6-d7625edc6382 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:22.893044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-def99193-024f-448e-9fc6-d7625edc6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:22.901849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:22.937519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaea283-0b1d-4a6a-aa08-ad8fab3df346 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:22.948696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaea283-0b1d-4a6a-aa08-ad8fab3df346 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:22.952120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a832bc-ee8c-4623-b9fa-25aea3394e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:22.952751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a832bc-ee8c-4623-b9fa-25aea3394e1d service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:22.953034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a832bc-ee8c-4623-b9fa-25aea3394e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:22.953308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a832bc-ee8c-4623-b9fa-25aea3394e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:22.962486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a832bc-ee8c-4623-b9fa-25aea3394e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:22.963910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a832bc-ee8c-4623-b9fa-25aea3394e1d service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:22.973235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 733/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:56.066172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdc77c-1d42-4deb-ac48-135a83539320 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:56.066836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdc77c-1d42-4deb-ac48-135a83539320 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:56.066836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdc77c-1d42-4deb-ac48-135a83539320 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:56.068075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 738/1471] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:56.073211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f1a0-4804-4972-9623-2a26b9c068af None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:56.073651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f1a0-4804-4972-9623-2a26b9c068af None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:56.073812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f1a0-4804-4972-9623-2a26b9c068af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:56.096274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a660f1a0-4804-4972-9623-2a26b9c068af None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:56.097492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a660f1a0-4804-4972-9623-2a26b9c068af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:56.105121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 734/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:56.151245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5cb1a-3a7b-4099-8e7c-acbce9ea4cbe None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:56.151532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5cb1a-3a7b-4099-8e7c-acbce9ea4cbe None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:56.151808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5cb1a-3a7b-4099-8e7c-acbce9ea4cbe None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:56.153153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 739/1473] 10.222.0.36 () {54 vars in 962 bytes} [Wed May 11 07:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:56.157935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed571af-733e-4412-b2f0-d9265e13b83b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:56.158226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed571af-733e-4412-b2f0-d9265e13b83b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:56.158501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed571af-733e-4412-b2f0-d9265e13b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:56.176129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-fed571af-733e-4412-b2f0-d9265e13b83b None None] MFA Rules not processed for user `91feeca74fe749fba52423aa28d48916`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:56.177311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-fed571af-733e-4412-b2f0-d9265e13b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:56.183599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 735/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Wed May 11 07:32:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:56.191545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5cb1a-3a7b-4099-8e7c-acbce9ea4cbe None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:56.201896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5cb1a-3a7b-4099-8e7c-acbce9ea4cbe None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:56.205262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e90b4c-ba3c-45c5-b47e-10a541319044 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91feeca74fe749fba52423aa28d48916', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:56.205917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90b4c-ba3c-45c5-b47e-10a541319044 service glance] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:56.206838 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90b4c-ba3c-45c5-b47e-10a541319044 service glance] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:56.207110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e90b4c-ba3c-45c5-b47e-10a541319044 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:56.215621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e90b4c-ba3c-45c5-b47e-10a541319044 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:56.217030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e90b4c-ba3c-45c5-b47e-10a541319044 service glance] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:56.225944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 740/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:32:58.511642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17e3b-8a80-46f7-ac31-b15b73ffa337 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:58.512118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17e3b-8a80-46f7-ac31-b15b73ffa337 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:58.512118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17e3b-8a80-46f7-ac31-b15b73ffa337 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:58.513497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 736/1476] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:32:58.518717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3e58-09f4-4f3d-90b3-0a78cab2e7ec None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:58.519123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3e58-09f4-4f3d-90b3-0a78cab2e7ec None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:58.519279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3e58-09f4-4f3d-90b3-0a78cab2e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:58.536946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-acec3e58-09f4-4f3d-90b3-0a78cab2e7ec None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:32:58.538170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-acec3e58-09f4-4f3d-90b3-0a78cab2e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:32:58.545841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 741/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:32:58.569377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde17e3b-8a80-46f7-ac31-b15b73ffa337 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:32:58.581900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde17e3b-8a80-46f7-ac31-b15b73ffa337 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:32:58.586259 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544caff4-136d-40f7-9314-d22868c9820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:32:58.586895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544caff4-136d-40f7-9314-d22868c9820f admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:32:58.587205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544caff4-136d-40f7-9314-d22868c9820f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:32:58.587478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544caff4-136d-40f7-9314-d22868c9820f admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:32:58.588201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544caff4-136d-40f7-9314-d22868c9820f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:32:58.589972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING py.warnings [None req-544caff4-136d-40f7-9314-d22868c9820f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:32:58.589972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: warnings.warn(msg) May 11 07:32:58.589972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: May 11 07:32:58.591101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544caff4-136d-40f7-9314-d22868c9820f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:32:58.609860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 737/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Wed May 11 07:32:58 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:33:00.825194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac34d35-2576-49dd-8b8b-0cb9aa303400 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:00.825786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac34d35-2576-49dd-8b8b-0cb9aa303400 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:00.825786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac34d35-2576-49dd-8b8b-0cb9aa303400 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:00.827141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 742/1479] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:33:00.832777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641356d8-09d3-4472-8d1e-7fcb0a60e4b0 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:00.833201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641356d8-09d3-4472-8d1e-7fcb0a60e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:00.833343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641356d8-09d3-4472-8d1e-7fcb0a60e4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:00.851253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-641356d8-09d3-4472-8d1e-7fcb0a60e4b0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:00.852460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-641356d8-09d3-4472-8d1e-7fcb0a60e4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:00.860205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 738/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:00.900976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac34d35-2576-49dd-8b8b-0cb9aa303400 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:00.915627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac34d35-2576-49dd-8b8b-0cb9aa303400 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:00.920864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39690a-7376-4055-8f71-f0ab61d13b0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:00.921489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39690a-7376-4055-8f71-f0ab61d13b0d service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:00.921796 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39690a-7376-4055-8f71-f0ab61d13b0d service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:00.922066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39690a-7376-4055-8f71-f0ab61d13b0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:00.929778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39690a-7376-4055-8f71-f0ab61d13b0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:00.931342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39690a-7376-4055-8f71-f0ab61d13b0d service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:00.940560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 743/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:03.341293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c8f8d-f88d-4a4b-b050-9db1171ce132 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:03.341897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c8f8d-f88d-4a4b-b050-9db1171ce132 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:03.341897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c8f8d-f88d-4a4b-b050-9db1171ce132 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:03.343303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 739/1482] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:33:03.348492 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc49ba-deb3-4762-a2ff-17ca5711cd95 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:03.348888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc49ba-deb3-4762-a2ff-17ca5711cd95 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:03.349047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc49ba-deb3-4762-a2ff-17ca5711cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:03.366695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e7bc49ba-deb3-4762-a2ff-17ca5711cd95 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:03.367887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e7bc49ba-deb3-4762-a2ff-17ca5711cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:03.375489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 744/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:03.410485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c8f8d-f88d-4a4b-b050-9db1171ce132 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:03.420942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c8f8d-f88d-4a4b-b050-9db1171ce132 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:03.425230 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27129d-c702-4a92-afad-7fe5f746ae31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:03.426042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27129d-c702-4a92-afad-7fe5f746ae31 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:03.426206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27129d-c702-4a92-afad-7fe5f746ae31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:03.426481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27129d-c702-4a92-afad-7fe5f746ae31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:03.435387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27129d-c702-4a92-afad-7fe5f746ae31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:03.436813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27129d-c702-4a92-afad-7fe5f746ae31 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:03.446899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 740/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:05.751939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547fd4-8de0-4317-bb88-f41f2ea8898a None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:05.752464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547fd4-8de0-4317-bb88-f41f2ea8898a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:05.752464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547fd4-8de0-4317-bb88-f41f2ea8898a None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:05.754310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 745/1485] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:33:05.759569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06e440-be4f-4bfe-b5c9-e183f428ec5f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:05.760007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06e440-be4f-4bfe-b5c9-e183f428ec5f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:05.760126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06e440-be4f-4bfe-b5c9-e183f428ec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:05.777727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ba06e440-be4f-4bfe-b5c9-e183f428ec5f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:05.778923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ba06e440-be4f-4bfe-b5c9-e183f428ec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:05.786527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 741/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:05.824496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb547fd4-8de0-4317-bb88-f41f2ea8898a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:05.835452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb547fd4-8de0-4317-bb88-f41f2ea8898a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:05.838888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fedd5f-66f7-4e3e-bd20-75805bf7d0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:05.839517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fedd5f-66f7-4e3e-bd20-75805bf7d0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:05.839799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fedd5f-66f7-4e3e-bd20-75805bf7d0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:05.840074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fedd5f-66f7-4e3e-bd20-75805bf7d0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:05.848682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fedd5f-66f7-4e3e-bd20-75805bf7d0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:05.850152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fedd5f-66f7-4e3e-bd20-75805bf7d0e4 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:05.859143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 746/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:33:08.213817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed855d9-450f-4f3c-bf74-49e4b7c2b007 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:08.214457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed855d9-450f-4f3c-bf74-49e4b7c2b007 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:08.214457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed855d9-450f-4f3c-bf74-49e4b7c2b007 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:08.215815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 742/1488] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:33:08.220926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157da5e-150d-4371-b57a-a35ff09a78ba None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:08.221388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157da5e-150d-4371-b57a-a35ff09a78ba None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:08.221571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157da5e-150d-4371-b57a-a35ff09a78ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:08.238842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-3157da5e-150d-4371-b57a-a35ff09a78ba None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:08.240076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3157da5e-150d-4371-b57a-a35ff09a78ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:08.247883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 747/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:08.287979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed855d9-450f-4f3c-bf74-49e4b7c2b007 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:08.298491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed855d9-450f-4f3c-bf74-49e4b7c2b007 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:08.302003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc827b87-4a86-4483-bac8-5e7239af842d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:08.302638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc827b87-4a86-4483-bac8-5e7239af842d service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:08.302926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc827b87-4a86-4483-bac8-5e7239af842d service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:08.303204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc827b87-4a86-4483-bac8-5e7239af842d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:08.311828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc827b87-4a86-4483-bac8-5e7239af842d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:08.313263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc827b87-4a86-4483-bac8-5e7239af842d service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:08.323105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 743/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:33:10.735240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc4634-9fea-474d-96a2-540f4860eacd None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:10.735778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc4634-9fea-474d-96a2-540f4860eacd None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:10.735778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc4634-9fea-474d-96a2-540f4860eacd None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:10.737600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 748/1491] 10.222.0.36 () {54 vars in 926 bytes} [Wed May 11 07:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:33:10.742728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747c7e4-d04e-4d68-8350-9070fa93b2e9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:10.743165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747c7e4-d04e-4d68-8350-9070fa93b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:10.743291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747c7e4-d04e-4d68-8350-9070fa93b2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:10.761370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a747c7e4-d04e-4d68-8350-9070fa93b2e9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:33:10.762600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a747c7e4-d04e-4d68-8350-9070fa93b2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:33:10.770463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 744/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Wed May 11 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:33:10.808848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc4634-9fea-474d-96a2-540f4860eacd None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:33:10.820733 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc4634-9fea-474d-96a2-540f4860eacd None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:33:10.824159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d56b3b-3ac3-49d4-b33e-665d8e8051b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:33:10.824782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d56b3b-3ac3-49d4-b33e-665d8e8051b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:33:10.825061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d56b3b-3ac3-49d4-b33e-665d8e8051b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:33:10.825335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d56b3b-3ac3-49d4-b33e-665d8e8051b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:33:10.835110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d56b3b-3ac3-49d4-b33e-665d8e8051b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:33:10.836529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d56b3b-3ac3-49d4-b33e-665d8e8051b8 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:33:10.845513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 749/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:37.725118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e277d-26bb-4804-ab90-de4a1dda6d2b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:37.725699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e277d-26bb-4804-ab90-de4a1dda6d2b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:37.725699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e277d-26bb-4804-ab90-de4a1dda6d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:37.744778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0d8e277d-26bb-4804-ab90-de4a1dda6d2b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:37.746016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0d8e277d-26bb-4804-ab90-de4a1dda6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:37.754624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 745/1494] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:37.763562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d4f5-ef90-41cf-80c4-a4f34500363b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:37.764059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d4f5-ef90-41cf-80c4-a4f34500363b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:37.764167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d4f5-ef90-41cf-80c4-a4f34500363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:37.781585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ecb5d4f5-ef90-41cf-80c4-a4f34500363b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:37.782775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ecb5d4f5-ef90-41cf-80c4-a4f34500363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:37.790500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 750/1495] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:37.794906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e277d-26bb-4804-ab90-de4a1dda6d2b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:37.804679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e277d-26bb-4804-ab90-de4a1dda6d2b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:37.809077 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:37.809769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:37.810056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:37.810334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:37.811060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:34:37.811370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:37.812378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING py.warnings [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:34:37.812378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: warnings.warn(msg) May 11 07:34:37.812378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: May 11 07:34:37.813952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:37.825237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 746/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:34:37.833398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d4f5-ef90-41cf-80c4-a4f34500363b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:37.843601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d4f5-ef90-41cf-80c4-a4f34500363b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:37.848244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:37.848900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:37.849176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:37.849456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:37.850208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:37.851992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WARNING py.warnings [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:34:37.851992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: warnings.warn(msg) May 11 07:34:37.851992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: May 11 07:34:37.853189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:37.887892 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 751/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:34:37 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:34:37.892094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:37.901732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514adb-9e99-4c05-8f13-86c03927970b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:37.957480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:37.958174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:37.958464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:37.958741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:37.959434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:37.960453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING py.warnings [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:34:37.960453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: warnings.warn(msg) May 11 07:34:37.960453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: May 11 07:34:37.961679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:37.983858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 747/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:34:37 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:34:37.988506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:37.998371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970df5c0-c0ab-4422-a3b7-6bbfb38ab3e7 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:38.003292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:38.003939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.004223 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.004499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.005215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:38.006261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WARNING py.warnings [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:34:38.006261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: warnings.warn(msg) May 11 07:34:38.006261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: May 11 07:34:38.007137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:38.019816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 752/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:34:38.023766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:38.033406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbe68-2903-4e4d-a311-1d4c1038def9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:38.037903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3c224-73c7-4860-af4f-84eaca27a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:38.038596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3c224-73c7-4860-af4f-84eaca27a53b admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.038883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3c224-73c7-4860-af4f-84eaca27a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.039162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3c224-73c7-4860-af4f-84eaca27a53b admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.039895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3c224-73c7-4860-af4f-84eaca27a53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:38.040916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING py.warnings [None req-68e3c224-73c7-4860-af4f-84eaca27a53b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:34:38.040916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: warnings.warn(msg) May 11 07:34:38.040916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: May 11 07:34:38.041820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3c224-73c7-4860-af4f-84eaca27a53b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:38.060042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 748/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:34:38.065381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:38.076787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267840-35c6-40da-9468-fc489cbfabff admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:38.081939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa40b9-7973-4076-8b12-6d97d9c49ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:38.082817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa40b9-7973-4076-8b12-6d97d9c49ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.083102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa40b9-7973-4076-8b12-6d97d9c49ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.083378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa40b9-7973-4076-8b12-6d97d9c49ad7 admin admin] PATH_INFO: `/v3/projects/5c6197a2466a4412b25c6722884ebdf7/users/c0c2342bb694497885ab8dcb9331d228/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.097520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa40b9-7973-4076-8b12-6d97d9c49ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6197a2466a4412b25c6722884ebdf7, user_id=c0c2342bb694497885ab8dcb9331d228, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:38.098577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WARNING py.warnings [None req-8efa40b9-7973-4076-8b12-6d97d9c49ad7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:34:38.098577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: warnings.warn(msg) May 11 07:34:38.098577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: May 11 07:34:38.100495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa40b9-7973-4076-8b12-6d97d9c49ad7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:38.112716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 753/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:34:38 2022] PUT /identity/v3/projects/5c6197a2466a4412b25c6722884ebdf7/users/c0c2342bb694497885ab8dcb9331d228/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:38.123796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c64f9-c546-427e-a0b8-38b77d3ad5f9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.124089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c64f9-c546-427e-a0b8-38b77d3ad5f9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.124372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c64f9-c546-427e-a0b8-38b77d3ad5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.152660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-282c64f9-c546-427e-a0b8-38b77d3ad5f9 None None] MFA Rules not processed for user `c0c2342bb694497885ab8dcb9331d228`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:38.154044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-282c64f9-c546-427e-a0b8-38b77d3ad5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:38.215177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 749/1502] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:34:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:38.228403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96795b-f74d-42e7-a979-d53a7eb37cf7 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.228696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96795b-f74d-42e7-a979-d53a7eb37cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.228995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96795b-f74d-42e7-a979-d53a7eb37cf7 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.230367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 754/1503] 10.222.0.36 () {54 vars in 963 bytes} [Wed May 11 07:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:34:38.235137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e2f0-dad6-43cc-9230-a93e471fe183 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.235373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e2f0-dad6-43cc-9230-a93e471fe183 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.235655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e2f0-dad6-43cc-9230-a93e471fe183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.253149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e523e2f0-dad6-43cc-9230-a93e471fe183 None None] MFA Rules not processed for user `529651ab9dd74ee1b50382d03800aea8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:38.254384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e523e2f0-dad6-43cc-9230-a93e471fe183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:38.301723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 750/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Wed May 11 07:34:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:38.308858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96795b-f74d-42e7-a979-d53a7eb37cf7 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:38.319811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96795b-f74d-42e7-a979-d53a7eb37cf7 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:38.323285 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e28fc6-4371-4582-8c79-0e1fcd6915f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:38.323904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28fc6-4371-4582-8c79-0e1fcd6915f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.324185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28fc6-4371-4582-8c79-0e1fcd6915f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.324458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28fc6-4371-4582-8c79-0e1fcd6915f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.332970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e28fc6-4371-4582-8c79-0e1fcd6915f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:38.334428 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e28fc6-4371-4582-8c79-0e1fcd6915f0 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:38.342741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 755/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:34:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:38.388687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269eb5-2207-4d4b-b818-d65ad70f95c5 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.388981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269eb5-2207-4d4b-b818-d65ad70f95c5 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.389264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269eb5-2207-4d4b-b818-d65ad70f95c5 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.390993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 751/1506] 10.222.0.36 () {52 vars in 829 bytes} [Wed May 11 07:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:34:38.395358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e28fc6-4371-4582-8c79-0e1fcd6915f0 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:38.455700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e28fc6-4371-4582-8c79-0e1fcd6915f0 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:38.460144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:38.461008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.461287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.461582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] PATH_INFO: `/v3/users/c0c2342bb694497885ab8dcb9331d228` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.462755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c2342bb694497885ab8dcb9331d228)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:38.463761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WARNING py.warnings [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:34:38.463761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: warnings.warn(msg) May 11 07:34:38.463761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: May 11 07:34:38.464949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:38.527530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c2342bb694497885ab8dcb9331d228'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:38.545111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c2342bb694497885ab8dcb9331d228'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:38.557195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c2342bb694497885ab8dcb9331d228'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:38.557982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c2342bb694497885ab8dcb9331d228'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:38.567426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c2342bb694497885ab8dcb9331d228'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:38.573373 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 756/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:34:38 2022] DELETE /identity/v3/users/c0c2342bb694497885ab8dcb9331d228 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:34:38.577910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b2d3-2741-4725-b5c6-54613f289cc0 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.578199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b2d3-2741-4725-b5c6-54613f289cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.578532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b2d3-2741-4725-b5c6-54613f289cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.595183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8cc4b2d3-2741-4725-b5c6-54613f289cc0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:34:38.596349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8cc4b2d3-2741-4725-b5c6-54613f289cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:38.651718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 752/1508] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:34:38.661251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:38.662741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:38.850670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad90c57-4542-4a73-a2c8-eb92700eead6 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:38.854342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c160b7b-c358-4206-8f01-9d95047bcc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:38.854989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c160b7b-c358-4206-8f01-9d95047bcc67 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:38.855274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c160b7b-c358-4206-8f01-9d95047bcc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:38.855579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c160b7b-c358-4206-8f01-9d95047bcc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:38.865080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c160b7b-c358-4206-8f01-9d95047bcc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:38.866541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c160b7b-c358-4206-8f01-9d95047bcc67 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:38.875795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 757/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:34:39.202301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b2d3-2741-4725-b5c6-54613f289cc0 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:34:39.204354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8cc4b2d3-2741-4725-b5c6-54613f289cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:34:39.216105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b2d3-2741-4725-b5c6-54613f289cc0 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:34:39.223009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:34:39.224099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:34:39.224399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:34:39.224777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] PATH_INFO: `/v3/projects/5c6197a2466a4412b25c6722884ebdf7` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:34:39.227228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6197a2466a4412b25c6722884ebdf7)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:34:39.228383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING py.warnings [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:34:39.228383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: warnings.warn(msg) May 11 07:34:39.228383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: May 11 07:34:39.229772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:34:39.290050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6197a2466a4412b25c6722884ebdf7', 'request_id': 'req-1c1d6c4f-d347-4705-8629-42d753157a5d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:39.295850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6197a2466a4412b25c6722884ebdf7', 'request_id': 'req-1c1d6c4f-d347-4705-8629-42d753157a5d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:39.304702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6197a2466a4412b25c6722884ebdf7', 'request_id': 'req-1c1d6c4f-d347-4705-8629-42d753157a5d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:39.322596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] The token cache is being invalidate because project 5c6197a2466a4412b25c6722884ebdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:34:39.322880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:39.323507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1c1d6c4f-d347-4705-8629-42d753157a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:34:39.325126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 753/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:34:39 2022] DELETE /identity/v3/projects/5c6197a2466a4412b25c6722884ebdf7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:36:20.291043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa9d3-8b9a-41d2-8106-abe13918cca1 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:20.291641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa9d3-8b9a-41d2-8106-abe13918cca1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:20.291641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa9d3-8b9a-41d2-8106-abe13918cca1 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:20.292993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:20.298313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493041c-5d1a-463a-ba7d-0cbfd5237e95 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:20.298721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493041c-5d1a-463a-ba7d-0cbfd5237e95 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:20.298874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493041c-5d1a-463a-ba7d-0cbfd5237e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:20.318865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4493041c-5d1a-463a-ba7d-0cbfd5237e95 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:20.320071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4493041c-5d1a-463a-ba7d-0cbfd5237e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:20.376679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:36:20.545165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa9d3-8b9a-41d2-8106-abe13918cca1 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:20.546770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-962aa9d3-8b9a-41d2-8106-abe13918cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:20.617679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa9d3-8b9a-41d2-8106-abe13918cca1 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:20.622889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f8a1d-2303-4aad-ab18-40522940dd6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:20.623514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f8a1d-2303-4aad-ab18-40522940dd6b service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:20.623792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f8a1d-2303-4aad-ab18-40522940dd6b service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:20.624056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f8a1d-2303-4aad-ab18-40522940dd6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:20.632306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f8a1d-2303-4aad-ab18-40522940dd6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:20.633883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f8a1d-2303-4aad-ab18-40522940dd6b service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:20.642919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 759/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:21.213715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0706-9e7c-46c7-a8d6-af4983fd7182 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:21.214009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0706-9e7c-46c7-a8d6-af4983fd7182 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:21.214309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee0706-9e7c-46c7-a8d6-af4983fd7182 None None] PATH_INFO: `/v3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:21.215671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 755/1514] 10.222.0.24 () {54 vars in 925 bytes} [Wed May 11 07:36:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:36:21.230130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431482d-cbd0-40f4-a31c-ae4f3f050f38 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:21.230357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431482d-cbd0-40f4-a31c-ae4f3f050f38 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:21.230628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431482d-cbd0-40f4-a31c-ae4f3f050f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:21.248396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9431482d-cbd0-40f4-a31c-ae4f3f050f38 None None] MFA Rules not processed for user `a1b36840995045199ec96eac939d5d35`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:21.249841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9431482d-cbd0-40f4-a31c-ae4f3f050f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:21.309901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 760/1515] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 11 07:36:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:36:21.547798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e630-0e41-436c-a0f9-4ebc3dc31833 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:21.548235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e630-0e41-436c-a0f9-4ebc3dc31833 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:21.548344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e630-0e41-436c-a0f9-4ebc3dc31833 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:21.549772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 756/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:21.554644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b412c-ead1-4adc-a0b8-8d1c6c56c230 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:21.554935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b412c-ead1-4adc-a0b8-8d1c6c56c230 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:21.555213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b412c-ead1-4adc-a0b8-8d1c6c56c230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:21.573684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c71b412c-ead1-4adc-a0b8-8d1c6c56c230 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:21.574870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c71b412c-ead1-4adc-a0b8-8d1c6c56c230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:21.583416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 761/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:36:21.734428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e630-0e41-436c-a0f9-4ebc3dc31833 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:21.748499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e630-0e41-436c-a0f9-4ebc3dc31833 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:21.754391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723d233-67d4-428e-8686-ba2bcb93cb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:21.755019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d233-67d4-428e-8686-ba2bcb93cb15 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:21.755304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d233-67d4-428e-8686-ba2bcb93cb15 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:21.755582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723d233-67d4-428e-8686-ba2bcb93cb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:21.763491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d233-67d4-428e-8686-ba2bcb93cb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:21.765101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723d233-67d4-428e-8686-ba2bcb93cb15 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:21.774942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 757/1518] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:25.230254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716b9b4-b77b-4e09-b0b5-59eba9ab6dba None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:25.230799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716b9b4-b77b-4e09-b0b5-59eba9ab6dba None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:25.230799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716b9b4-b77b-4e09-b0b5-59eba9ab6dba None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:25.232150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 762/1519] 10.222.0.36 () {54 vars in 960 bytes} [Wed May 11 07:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:25.237084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66cf8-d0b5-4fe2-8500-c8132997e9d2 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:25.237511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66cf8-d0b5-4fe2-8500-c8132997e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:25.237675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b66cf8-d0b5-4fe2-8500-c8132997e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:25.255774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-51b66cf8-d0b5-4fe2-8500-c8132997e9d2 None None] MFA Rules not processed for user `a1b36840995045199ec96eac939d5d35`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:25.256954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-51b66cf8-d0b5-4fe2-8500-c8132997e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:25.265313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 758/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Wed May 11 07:36:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:36:25.273147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716b9b4-b77b-4e09-b0b5-59eba9ab6dba None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:25.285958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716b9b4-b77b-4e09-b0b5-59eba9ab6dba None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:25.290819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f83ab-ce1c-4040-8dea-463400e6bae5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:25.291437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f83ab-ce1c-4040-8dea-463400e6bae5 service placement] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:25.291718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f83ab-ce1c-4040-8dea-463400e6bae5 service placement] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:25.291992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f83ab-ce1c-4040-8dea-463400e6bae5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:25.299962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f83ab-ce1c-4040-8dea-463400e6bae5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:25.301530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f83ab-ce1c-4040-8dea-463400e6bae5 service placement] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:25.310765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 763/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:33.077354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a842-8837-4b5b-b30e-90248ff8f307 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:33.077951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a842-8837-4b5b-b30e-90248ff8f307 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:33.077951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a842-8837-4b5b-b30e-90248ff8f307 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:33.079873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:33.084674 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ba7e-b892-47e9-bd93-0ae2b1c5dc26 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:33.085120 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ba7e-b892-47e9-bd93-0ae2b1c5dc26 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:33.085230 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ba7e-b892-47e9-bd93-0ae2b1c5dc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:33.103139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6b85ba7e-b892-47e9-bd93-0ae2b1c5dc26 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:33.104298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6b85ba7e-b892-47e9-bd93-0ae2b1c5dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:33.111998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:36:33.260646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626a842-8837-4b5b-b30e-90248ff8f307 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:33.275204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626a842-8837-4b5b-b30e-90248ff8f307 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:33.280488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096c522-6845-4866-baac-a96a37c87af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:33.281116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096c522-6845-4866-baac-a96a37c87af5 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:33.282050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096c522-6845-4866-baac-a96a37c87af5 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:33.282331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096c522-6845-4866-baac-a96a37c87af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:33.290178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096c522-6845-4866-baac-a96a37c87af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:33.291747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096c522-6845-4866-baac-a96a37c87af5 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:33.300835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 760/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:34.200247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853329-39f7-43f4-9892-4d75a3fc78ae None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:34.200809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853329-39f7-43f4-9892-4d75a3fc78ae None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:34.200809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb853329-39f7-43f4-9892-4d75a3fc78ae None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:34.202224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 07:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:34.207609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0db2c-fe5b-4e35-bf24-daa2c6517ec7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:34.208128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0db2c-fe5b-4e35-bf24-daa2c6517ec7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:34.208236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0db2c-fe5b-4e35-bf24-daa2c6517ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:34.228264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4cb0db2c-fe5b-4e35-bf24-daa2c6517ec7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:34.229480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4cb0db2c-fe5b-4e35-bf24-daa2c6517ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:34.238663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 07:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:36:34.388595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb853329-39f7-43f4-9892-4d75a3fc78ae None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:34.402475 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb853329-39f7-43f4-9892-4d75a3fc78ae None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:34.408264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df9bd9-c5c8-4757-902a-ee2577d0a408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:34.408887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df9bd9-c5c8-4757-902a-ee2577d0a408 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:34.409167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df9bd9-c5c8-4757-902a-ee2577d0a408 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:34.409438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df9bd9-c5c8-4757-902a-ee2577d0a408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:34.417148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df9bd9-c5c8-4757-902a-ee2577d0a408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:34.418753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df9bd9-c5c8-4757-902a-ee2577d0a408 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:34.428331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 766/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:38.406725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344333f-ef2c-424c-85a8-80a9f4204faf None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:38.407306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344333f-ef2c-424c-85a8-80a9f4204faf None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:38.407306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344333f-ef2c-424c-85a8-80a9f4204faf None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:38.408661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:38.413861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7170-9439-474e-89fe-319ebaa9e579 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:38.414326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7170-9439-474e-89fe-319ebaa9e579 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:38.414452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b7170-9439-474e-89fe-319ebaa9e579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:38.432111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-867b7170-9439-474e-89fe-319ebaa9e579 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:38.433311 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-867b7170-9439-474e-89fe-319ebaa9e579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:38.441751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:36:38.477400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344333f-ef2c-424c-85a8-80a9f4204faf None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:38.480105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7344333f-ef2c-424c-85a8-80a9f4204faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:38.533620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344333f-ef2c-424c-85a8-80a9f4204faf None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:38.537114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872908f5-11bb-46d3-8bd6-a4ae3e9e5db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:38.537775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908f5-11bb-46d3-8bd6-a4ae3e9e5db7 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:38.538059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908f5-11bb-46d3-8bd6-a4ae3e9e5db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:38.538334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872908f5-11bb-46d3-8bd6-a4ae3e9e5db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:38.547322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872908f5-11bb-46d3-8bd6-a4ae3e9e5db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:38.548741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872908f5-11bb-46d3-8bd6-a4ae3e9e5db7 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:38.557667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 763/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:40.754060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ec90-fd8f-44b4-a385-fb3d79408396 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:40.754574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ec90-fd8f-44b4-a385-fb3d79408396 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:40.754574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82ec90-fd8f-44b4-a385-fb3d79408396 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:40.755908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:40.761092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f5328-78f9-472a-9f91-f0d829dbceff None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:40.761497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f5328-78f9-472a-9f91-f0d829dbceff None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:40.761694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f5328-78f9-472a-9f91-f0d829dbceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:40.779913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d75f5328-78f9-472a-9f91-f0d829dbceff None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:40.781719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d75f5328-78f9-472a-9f91-f0d829dbceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:40.789343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:36:40.824354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82ec90-fd8f-44b4-a385-fb3d79408396 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:40.835224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82ec90-fd8f-44b4-a385-fb3d79408396 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:40.838728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fedb6-ad1e-4c35-a1dd-2ba4ec895d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:40.839353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fedb6-ad1e-4c35-a1dd-2ba4ec895d64 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:40.839633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fedb6-ad1e-4c35-a1dd-2ba4ec895d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:40.839908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fedb6-ad1e-4c35-a1dd-2ba4ec895d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:40.849042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fedb6-ad1e-4c35-a1dd-2ba4ec895d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:40.850485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fedb6-ad1e-4c35-a1dd-2ba4ec895d64 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:40.859527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 769/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:36:44.713784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540bb61-b8f0-4219-8f15-941eb792023c None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:44.714378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540bb61-b8f0-4219-8f15-941eb792023c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:44.714378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540bb61-b8f0-4219-8f15-941eb792023c None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:44.715718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:44.721467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c9f71-b2ff-414d-8303-df0c8b7a784f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:44.721961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c9f71-b2ff-414d-8303-df0c8b7a784f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:44.722070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c9f71-b2ff-414d-8303-df0c8b7a784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:44.740098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-fc6c9f71-b2ff-414d-8303-df0c8b7a784f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:44.741230 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-fc6c9f71-b2ff-414d-8303-df0c8b7a784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:44.748989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:36:45.018002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540bb61-b8f0-4219-8f15-941eb792023c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:45.019636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a540bb61-b8f0-4219-8f15-941eb792023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:45.074007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540bb61-b8f0-4219-8f15-941eb792023c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:45.077494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398afac-9a6f-4dec-bf13-7b72af511e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:45.078676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398afac-9a6f-4dec-bf13-7b72af511e90 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:45.078956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398afac-9a6f-4dec-bf13-7b72af511e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:45.079229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398afac-9a6f-4dec-bf13-7b72af511e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:45.087819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398afac-9a6f-4dec-bf13-7b72af511e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:45.089242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398afac-9a6f-4dec-bf13-7b72af511e90 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:45.098914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 766/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:36:47.362473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287388-6b13-4b53-8983-f469d9d42a96 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:47.363017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287388-6b13-4b53-8983-f469d9d42a96 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:47.363017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc287388-6b13-4b53-8983-f469d9d42a96 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:47.364394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 07:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:36:47.369932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650959-d440-4948-8648-ce04e8fbfe76 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:47.370460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650959-d440-4948-8648-ce04e8fbfe76 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:47.370699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51650959-d440-4948-8648-ce04e8fbfe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:47.388700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-51650959-d440-4948-8648-ce04e8fbfe76 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:36:47.389921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-51650959-d440-4948-8648-ce04e8fbfe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:47.397594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 07:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:36:47.668009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc287388-6b13-4b53-8983-f469d9d42a96 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:36:47.669699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bc287388-6b13-4b53-8983-f469d9d42a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:36:47.682856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc287388-6b13-4b53-8983-f469d9d42a96 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:36:47.686287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90e5f1-0c2a-4c49-99bd-f2305fa3eb6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:36:47.688309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e5f1-0c2a-4c49-99bd-f2305fa3eb6b service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:36:47.688594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e5f1-0c2a-4c49-99bd-f2305fa3eb6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:36:47.688865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90e5f1-0c2a-4c49-99bd-f2305fa3eb6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:36:47.697711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90e5f1-0c2a-4c49-99bd-f2305fa3eb6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:36:47.699135 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90e5f1-0c2a-4c49-99bd-f2305fa3eb6b service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:36:47.708585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 772/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:18.564063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177ad4-ea9e-4e5c-aa57-c613699999cc None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.564685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177ad4-ea9e-4e5c-aa57-c613699999cc None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.564685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177ad4-ea9e-4e5c-aa57-c613699999cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.592869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-03177ad4-ea9e-4e5c-aa57-c613699999cc None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:18.594121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-03177ad4-ea9e-4e5c-aa57-c613699999cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:18.605273 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 768/1540] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:18.616037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad1cc-50ac-40dd-a22e-15a19a483b11 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.617080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad1cc-50ac-40dd-a22e-15a19a483b11 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.617656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad1cc-50ac-40dd-a22e-15a19a483b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.646530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e3dad1cc-50ac-40dd-a22e-15a19a483b11 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:18.648199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e3dad1cc-50ac-40dd-a22e-15a19a483b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:18.657815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 773/1541] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:18.665700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177ad4-ea9e-4e5c-aa57-c613699999cc None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:18.670025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd65cea-cd17-4706-9d6e-073199f0f865 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.670717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd65cea-cd17-4706-9d6e-073199f0f865 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.671210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd65cea-cd17-4706-9d6e-073199f0f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.681499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177ad4-ea9e-4e5c-aa57-c613699999cc None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:18.696351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:18.697475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.698442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.698929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.699046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ecd65cea-cd17-4706-9d6e-073199f0f865 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:18.699990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:18.700170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ecd65cea-cd17-4706-9d6e-073199f0f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:18.700603 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:18.703205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:18.727678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 774/1542] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:18.729143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 769/1543] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:18.739891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:18.740806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a69ea-975b-4331-92c6-132e81700e8b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.749675 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a69ea-975b-4331-92c6-132e81700e8b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.750333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a69ea-975b-4331-92c6-132e81700e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.773954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24bd11-11ad-4685-85ea-31d0f53c64cb admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:18.782884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f72a69ea-975b-4331-92c6-132e81700e8b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:18.783990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852a332-95fd-4ef9-8486-0fc1fe6476b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:18.784277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f72a69ea-975b-4331-92c6-132e81700e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:18.785037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852a332-95fd-4ef9-8486-0fc1fe6476b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.785490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852a332-95fd-4ef9-8486-0fc1fe6476b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.785969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852a332-95fd-4ef9-8486-0fc1fe6476b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.786864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852a332-95fd-4ef9-8486-0fc1fe6476b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:18.788158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING py.warnings [None req-f852a332-95fd-4ef9-8486-0fc1fe6476b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:38:18.788158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: warnings.warn(msg) May 11 07:38:18.788158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: May 11 07:38:18.790091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852a332-95fd-4ef9-8486-0fc1fe6476b6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:18.809589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 775/1544] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:18.809849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39381b4c-a7f7-4626-aa6c-303cff18ef8b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.810142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39381b4c-a7f7-4626-aa6c-303cff18ef8b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.810424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39381b4c-a7f7-4626-aa6c-303cff18ef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.842409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 770/1545] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:18.844254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba86ea-b169-42f8-be8d-af1571033942 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.844719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-39381b4c-a7f7-4626-aa6c-303cff18ef8b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:18.844859 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba86ea-b169-42f8-be8d-af1571033942 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.845392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba86ea-b169-42f8-be8d-af1571033942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.845966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-39381b4c-a7f7-4626-aa6c-303cff18ef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:18.882649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-64ba86ea-b169-42f8-be8d-af1571033942 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:18.884602 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-64ba86ea-b169-42f8-be8d-af1571033942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:18.944101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 776/1546] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:18.944812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39381b4c-a7f7-4626-aa6c-303cff18ef8b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:18.954281 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39381b4c-a7f7-4626-aa6c-303cff18ef8b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:18.958714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace44f-87dc-40c1-8a1c-bd495078726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:18.959370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace44f-87dc-40c1-8a1c-bd495078726f admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.959656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace44f-87dc-40c1-8a1c-bd495078726f admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.959934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace44f-87dc-40c1-8a1c-bd495078726f admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.960663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ace44f-87dc-40c1-8a1c-bd495078726f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:18.960971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ace44f-87dc-40c1-8a1c-bd495078726f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:18.961171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 771/1547] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:18.962064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba86ea-b169-42f8-be8d-af1571033942 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:18.962190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WARNING py.warnings [None req-75ace44f-87dc-40c1-8a1c-bd495078726f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 07:38:18.962190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: warnings.warn(msg) May 11 07:38:18.962190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: May 11 07:38:18.963195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ace44f-87dc-40c1-8a1c-bd495078726f admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:18.971801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba86ea-b169-42f8-be8d-af1571033942 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:18.974911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 777/1548] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:18.976238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170f3c-5d71-40fe-bc13-795bdb5ff1fb None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.976530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170f3c-5d71-40fe-bc13-795bdb5ff1fb None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.976655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c756f-6667-4e78-93cc-39303acbaffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:18.976842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69170f3c-5d71-40fe-bc13-795bdb5ff1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.977202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c756f-6667-4e78-93cc-39303acbaffe admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:18.977484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c756f-6667-4e78-93cc-39303acbaffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:18.977788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c756f-6667-4e78-93cc-39303acbaffe admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:18.978494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c756f-6667-4e78-93cc-39303acbaffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:18.980433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c756f-6667-4e78-93cc-39303acbaffe admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:18.995071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-69170f3c-5d71-40fe-bc13-795bdb5ff1fb None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:18.996268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-69170f3c-5d71-40fe-bc13-795bdb5ff1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.004154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 772/1549] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/users => generated 303 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.004154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ecf0-a94a-4304-a32a-d90331eb1576 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.004154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ecf0-a94a-4304-a32a-d90331eb1576 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.004154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ecf0-a94a-4304-a32a-d90331eb1576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.007133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 778/1550] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.008518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bee96-0177-49f8-8375-3beda0bee7a1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.008806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bee96-0177-49f8-8375-3beda0bee7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.009277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bee96-0177-49f8-8375-3beda0bee7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.021288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8c15ecf0-a94a-4304-a32a-d90331eb1576 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.022547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8c15ecf0-a94a-4304-a32a-d90331eb1576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.029298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-4f9bee96-0177-49f8-8375-3beda0bee7a1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.030491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 773/1551] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.030628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4f9bee96-0177-49f8-8375-3beda0bee7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.031708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710720fb-3dd8-4112-b502-bcbf5ee97456 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.031994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710720fb-3dd8-4112-b502-bcbf5ee97456 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.032268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710720fb-3dd8-4112-b502-bcbf5ee97456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.054603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 779/1552] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.054603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd17f-628e-49c6-ab7b-926f1affb6e6 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.054603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd17f-628e-49c6-ab7b-926f1affb6e6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.054603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdd17f-628e-49c6-ab7b-926f1affb6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.055278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-710720fb-3dd8-4112-b502-bcbf5ee97456 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.055278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-710720fb-3dd8-4112-b502-bcbf5ee97456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.060610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 774/1553] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.065187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa8772-1d74-4436-b08d-a3185c18c7b5 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.065483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa8772-1d74-4436-b08d-a3185c18c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.065808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa8772-1d74-4436-b08d-a3185c18c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.067041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-02bdd17f-628e-49c6-ab7b-926f1affb6e6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.068223 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-02bdd17f-628e-49c6-ab7b-926f1affb6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.079352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 780/1554] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.079352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdd17f-628e-49c6-ab7b-926f1affb6e6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.084353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2afa8772-1d74-4436-b08d-a3185c18c7b5 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.085598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2afa8772-1d74-4436-b08d-a3185c18c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.086112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdd17f-628e-49c6-ab7b-926f1affb6e6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.090487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e8fdf-c10e-40f9-865b-cf5971b2aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.091119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e8fdf-c10e-40f9-865b-cf5971b2aad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.091398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e8fdf-c10e-40f9-865b-cf5971b2aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.091670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e8fdf-c10e-40f9-865b-cf5971b2aad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.092375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e8fdf-c10e-40f9-865b-cf5971b2aad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.093845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 775/1555] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.094834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e8fdf-c10e-40f9-865b-cf5971b2aad0 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.098108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa8772-1d74-4436-b08d-a3185c18c7b5 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.107240 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa8772-1d74-4436-b08d-a3185c18c7b5 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.112385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613625e-8ce2-415f-9383-eb4cf80740a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.113029 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613625e-8ce2-415f-9383-eb4cf80740a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.113310 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613625e-8ce2-415f-9383-eb4cf80740a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.113648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613625e-8ce2-415f-9383-eb4cf80740a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.114330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613625e-8ce2-415f-9383-eb4cf80740a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.115949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613625e-8ce2-415f-9383-eb4cf80740a9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.123931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 781/1556] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.123931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a077-2cb0-4075-99fb-79d1bc193d12 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.123931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a077-2cb0-4075-99fb-79d1bc193d12 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.123931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a077-2cb0-4075-99fb-79d1bc193d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.128781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 776/1557] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:19.128781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063a59a-3d88-4098-b097-5ada44be7cc6 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.128781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063a59a-3d88-4098-b097-5ada44be7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.128781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063a59a-3d88-4098-b097-5ada44be7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.143344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-07e5a077-2cb0-4075-99fb-79d1bc193d12 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.144499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4063a59a-3d88-4098-b097-5ada44be7cc6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.144625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-07e5a077-2cb0-4075-99fb-79d1bc193d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.145674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4063a59a-3d88-4098-b097-5ada44be7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.201337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 782/1558] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.202742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 777/1559] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.202896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865babb8-99fc-4d3f-92df-5d62624c6096 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.202992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865babb8-99fc-4d3f-92df-5d62624c6096 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.203248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865babb8-99fc-4d3f-92df-5d62624c6096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.203914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05761136-492f-45bb-9b6e-64556e4daa7b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.204203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05761136-492f-45bb-9b6e-64556e4daa7b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.204480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05761136-492f-45bb-9b6e-64556e4daa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.221094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-865babb8-99fc-4d3f-92df-5d62624c6096 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.221984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-05761136-492f-45bb-9b6e-64556e4daa7b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.222321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-865babb8-99fc-4d3f-92df-5d62624c6096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.223128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-05761136-492f-45bb-9b6e-64556e4daa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.230000 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 783/1560] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.234639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 778/1561] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.234795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865babb8-99fc-4d3f-92df-5d62624c6096 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.234909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05761136-492f-45bb-9b6e-64556e4daa7b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.241215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05761136-492f-45bb-9b6e-64556e4daa7b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.243035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865babb8-99fc-4d3f-92df-5d62624c6096 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.245670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.246242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.246522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.246820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.247527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:19.247637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.247828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.248205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.248490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.248806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.249437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.249567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:19.249845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.251457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.260545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 779/1562] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:19.261325 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.268253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 784/1563] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:19.268253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.273558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a718-d56b-470f-91cd-41dce96cae9b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.277096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a8b0d-3df5-4dd0-b2c7-713e17a43873 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.278243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc765-65e2-40dc-bf31-7d40ebb1f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.278933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc765-65e2-40dc-bf31-7d40ebb1f7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.279222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc765-65e2-40dc-bf31-7d40ebb1f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.279499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc765-65e2-40dc-bf31-7d40ebb1f7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.280700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bc765-65e2-40dc-bf31-7d40ebb1f7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.282276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006ed5f-5d99-4fb3-bccb-93c4700379b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.282676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bc765-65e2-40dc-bf31-7d40ebb1f7e6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.282961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ed5f-5d99-4fb3-bccb-93c4700379b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.283245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ed5f-5d99-4fb3-bccb-93c4700379b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.283518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ed5f-5d99-4fb3-bccb-93c4700379b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.284224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006ed5f-5d99-4fb3-bccb-93c4700379b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.285801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006ed5f-5d99-4fb3-bccb-93c4700379b2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.296652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 785/1564] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:19.300758 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006ed5f-5d99-4fb3-bccb-93c4700379b2 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.303211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 780/1565] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/users => generated 284 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.304017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc765-65e2-40dc-bf31-7d40ebb1f7e6 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.310097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006ed5f-5d99-4fb3-bccb-93c4700379b2 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.313049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc765-65e2-40dc-bf31-7d40ebb1f7e6 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.314476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.315108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.315381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.315646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.316602 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:19.316903 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.317801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.318434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.318550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.318717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.318987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.319808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:19.319998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.321577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.329846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 786/1566] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:19.330630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.334726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 781/1567] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:19.335835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.341516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b07c82-6f51-4d46-a234-beb4256daf3d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.346281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb393-1d45-48fc-bcd8-3026e4c81988 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.346564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.347240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.347512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.347791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.348502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:19.348806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.350418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.350887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.351515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.351798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.352074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.352778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:19.353083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.354660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.362909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 787/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:19.363691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.366594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 782/1569] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:19.367323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.376502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0a046-5171-492d-a17b-854be0c95c01 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.379962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d48dd-d9eb-4a5b-85b1-247ebd90cf5d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.380991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9145-ce40-4223-87ad-9b9f4aa23b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.381651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9145-ce40-4223-87ad-9b9f4aa23b3d admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.381930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9145-ce40-4223-87ad-9b9f4aa23b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.382204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9145-ce40-4223-87ad-9b9f4aa23b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.382877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db9145-ce40-4223-87ad-9b9f4aa23b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.384743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db9145-ce40-4223-87ad-9b9f4aa23b3d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.384860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fb86c-aace-400c-97dc-20f798d317e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.385446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fb86c-aace-400c-97dc-20f798d317e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.385769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fb86c-aace-400c-97dc-20f798d317e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.386047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fb86c-aace-400c-97dc-20f798d317e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.386738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fb86c-aace-400c-97dc-20f798d317e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.388640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fb86c-aace-400c-97dc-20f798d317e3 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.413474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 783/1570] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.413474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9145-ce40-4223-87ad-9b9f4aa23b3d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.413784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 788/1571] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.414786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fb86c-aace-400c-97dc-20f798d317e3 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.472503 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9145-ce40-4223-87ad-9b9f4aa23b3d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.476442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fb86c-aace-400c-97dc-20f798d317e3 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.477029 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.477957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.478243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.478516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] PATH_INFO: `/v3/projects/15328783fceb487482aa69d0d97ab95a/users/34cde8fce4dc46e39baeb4ec37fa20a0/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.482500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b6022-65ce-4a12-adec-2e9df5556802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.482500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6022-65ce-4a12-adec-2e9df5556802 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.482500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6022-65ce-4a12-adec-2e9df5556802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.482852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b6022-65ce-4a12-adec-2e9df5556802 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.483316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b6022-65ce-4a12-adec-2e9df5556802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.485336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b6022-65ce-4a12-adec-2e9df5556802 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.493311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15328783fceb487482aa69d0d97ab95a, user_id=34cde8fce4dc46e39baeb4ec37fa20a0, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.494389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING py.warnings [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:38:19.494389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: warnings.warn(msg) May 11 07:38:19.494389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: May 11 07:38:19.494791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 789/1572] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:19.495735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b6022-65ce-4a12-adec-2e9df5556802 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.496302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.506620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b6022-65ce-4a12-adec-2e9df5556802 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.509225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 784/1573] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:19 2022] PUT /identity/v3/projects/15328783fceb487482aa69d0d97ab95a/users/34cde8fce4dc46e39baeb4ec37fa20a0/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:19.510038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.561447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5ffbe-8bf3-45d7-be95-84437ee408ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.562138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5ffbe-8bf3-45d7-be95-84437ee408ca admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.562424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5ffbe-8bf3-45d7-be95-84437ee408ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.562838 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5ffbe-8bf3-45d7-be95-84437ee408ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.563532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5ffbe-8bf3-45d7-be95-84437ee408ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.565426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5ffbe-8bf3-45d7-be95-84437ee408ca admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.569785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513391-1ed9-4ddd-8820-dba324cfc179 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.574258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e9ef-89ae-4625-85af-5ade17cb7783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.574916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e9ef-89ae-4625-85af-5ade17cb7783 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.575197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e9ef-89ae-4625-85af-5ade17cb7783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.575470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e9ef-89ae-4625-85af-5ade17cb7783 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.576149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8e9ef-89ae-4625-85af-5ade17cb7783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.578588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8e9ef-89ae-4625-85af-5ade17cb7783 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.591087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 790/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.593330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5ffbe-8bf3-45d7-be95-84437ee408ca admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.608907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 785/1575] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.608907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e9ef-89ae-4625-85af-5ade17cb7783 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.654815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5ffbe-8bf3-45d7-be95-84437ee408ca admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.665319 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e9ef-89ae-4625-85af-5ade17cb7783 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.669927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb0a82-1f34-43cf-ac49-e0affbc46794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.670603 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0a82-1f34-43cf-ac49-e0affbc46794 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.670894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0a82-1f34-43cf-ac49-e0affbc46794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.671174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb0a82-1f34-43cf-ac49-e0affbc46794 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.671857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb0a82-1f34-43cf-ac49-e0affbc46794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.673792 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb0a82-1f34-43cf-ac49-e0affbc46794 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.702593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 786/1576] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.702593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb0a82-1f34-43cf-ac49-e0affbc46794 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.713341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea27eb2-6afe-43eb-bb30-c7520f23b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.714027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27eb2-6afe-43eb-bb30-c7520f23b1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.714304 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27eb2-6afe-43eb-bb30-c7520f23b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.714574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27eb2-6afe-43eb-bb30-c7520f23b1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.715252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea27eb2-6afe-43eb-bb30-c7520f23b1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.717138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea27eb2-6afe-43eb-bb30-c7520f23b1c1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.747573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 791/1577] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.747573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea27eb2-6afe-43eb-bb30-c7520f23b1c1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.761967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb0a82-1f34-43cf-ac49-e0affbc46794 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.803560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea27eb2-6afe-43eb-bb30-c7520f23b1c1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.808029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.808681 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.808964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.809234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.809940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.810945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WARNING py.warnings [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:38:19.810945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: warnings.warn(msg) May 11 07:38:19.810945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: May 11 07:38:19.812170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.815330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47914b45-ed8b-4fee-b295-061dd9f397a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.815993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47914b45-ed8b-4fee-b295-061dd9f397a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.816628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47914b45-ed8b-4fee-b295-061dd9f397a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.816908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47914b45-ed8b-4fee-b295-061dd9f397a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.817662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47914b45-ed8b-4fee-b295-061dd9f397a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.819638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47914b45-ed8b-4fee-b295-061dd9f397a8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.833634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 792/1578] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.834577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.839421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 787/1579] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.841025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beadee-88d5-45be-a021-9b8664d97bae None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.841316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beadee-88d5-45be-a021-9b8664d97bae None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.841733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14beadee-88d5-45be-a021-9b8664d97bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.844754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f701a-90ee-4141-8ae2-50390087554f admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.849317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf689ef-e896-4e31-85c8-6f1884904cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.849996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf689ef-e896-4e31-85c8-6f1884904cdc admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.850286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf689ef-e896-4e31-85c8-6f1884904cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.850562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf689ef-e896-4e31-85c8-6f1884904cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.851291 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf689ef-e896-4e31-85c8-6f1884904cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.852876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf689ef-e896-4e31-85c8-6f1884904cdc admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.865965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 793/1580] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:19.865965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf689ef-e896-4e31-85c8-6f1884904cdc admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.867528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-14beadee-88d5-45be-a021-9b8664d97bae None None] MFA Rules not processed for user `34cde8fce4dc46e39baeb4ec37fa20a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:19.868729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-14beadee-88d5-45be-a021-9b8664d97bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:19.875646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf689ef-e896-4e31-85c8-6f1884904cdc admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.880228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c219f-bbb0-4ebd-a6ad-3888fddafd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.880865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c219f-bbb0-4ebd-a6ad-3888fddafd83 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.881217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c219f-bbb0-4ebd-a6ad-3888fddafd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.881497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c219f-bbb0-4ebd-a6ad-3888fddafd83 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.882204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c219f-bbb0-4ebd-a6ad-3888fddafd83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.884082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c219f-bbb0-4ebd-a6ad-3888fddafd83 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.906777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 794/1581] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.907650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c219f-bbb0-4ebd-a6ad-3888fddafd83 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.916755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c219f-bbb0-4ebd-a6ad-3888fddafd83 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.921895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020322-8bcd-49af-9c6b-ad9da4baca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.922536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020322-8bcd-49af-9c6b-ad9da4baca62 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.922812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020322-8bcd-49af-9c6b-ad9da4baca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.923082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62020322-8bcd-49af-9c6b-ad9da4baca62 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.923753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62020322-8bcd-49af-9c6b-ad9da4baca62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.925693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62020322-8bcd-49af-9c6b-ad9da4baca62 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.937618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 788/1582] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:19.938599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beadee-88d5-45be-a021-9b8664d97bae None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.946283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 795/1583] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.947318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020322-8bcd-49af-9c6b-ad9da4baca62 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.949476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14beadee-88d5-45be-a021-9b8664d97bae None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.953998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ca924-549b-44df-930c-3001d2a2e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.954685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ca924-549b-44df-930c-3001d2a2e9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.954941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ca924-549b-44df-930c-3001d2a2e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.955258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ca924-549b-44df-930c-3001d2a2e9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.956038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ca924-549b-44df-930c-3001d2a2e9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.956654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62020322-8bcd-49af-9c6b-ad9da4baca62 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.958067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ca924-549b-44df-930c-3001d2a2e9c8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.961293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f386f18-5d67-47e1-b33e-1580e238a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.962139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386f18-5d67-47e1-b33e-1580e238a10b admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.962424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386f18-5d67-47e1-b33e-1580e238a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.962702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386f18-5d67-47e1-b33e-1580e238a10b admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.963387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f386f18-5d67-47e1-b33e-1580e238a10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.965311 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f386f18-5d67-47e1-b33e-1580e238a10b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:19.980651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 789/1584] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.980651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ca924-549b-44df-930c-3001d2a2e9c8 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.988667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 796/1585] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:19 2022] POST /identity/v3/users => generated 295 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:19.988667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f386f18-5d67-47e1-b33e-1580e238a10b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:19.990494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ca924-549b-44df-930c-3001d2a2e9c8 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.995091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a14571-f8f2-411b-a5aa-17ae5430cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:19.995738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14571-f8f2-411b-a5aa-17ae5430cd3e admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:19.995931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f386f18-5d67-47e1-b33e-1580e238a10b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:19.996052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14571-f8f2-411b-a5aa-17ae5430cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:19.996281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a14571-f8f2-411b-a5aa-17ae5430cd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:19.996995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a14571-f8f2-411b-a5aa-17ae5430cd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:19.998694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a14571-f8f2-411b-a5aa-17ae5430cd3e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.000529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f045b-c925-49f5-aad2-f8783d619df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.001167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f045b-c925-49f5-aad2-f8783d619df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.001453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f045b-c925-49f5-aad2-f8783d619df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.001763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f045b-c925-49f5-aad2-f8783d619df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.002478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f045b-c925-49f5-aad2-f8783d619df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.004044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f045b-c925-49f5-aad2-f8783d619df5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.008305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 790/1586] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.009072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a14571-f8f2-411b-a5aa-17ae5430cd3e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.014382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 797/1587] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.015191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f045b-c925-49f5-aad2-f8783d619df5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.018216 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a14571-f8f2-411b-a5aa-17ae5430cd3e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.022854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469a61-9626-4e59-a1ac-e24fd5cd27e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.023719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469a61-9626-4e59-a1ac-e24fd5cd27e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.024002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469a61-9626-4e59-a1ac-e24fd5cd27e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.024246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f045b-c925-49f5-aad2-f8783d619df5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.024350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469a61-9626-4e59-a1ac-e24fd5cd27e1 admin admin] PATH_INFO: `/v3/projects/f90f628876264b8bac72381eb338c07e/users/c23e90a89ee8446593637aba3c106989/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.028914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e236d-ce0c-44ad-9f2c-ca59594911da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.029561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e236d-ce0c-44ad-9f2c-ca59594911da admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.029858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e236d-ce0c-44ad-9f2c-ca59594911da admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.030653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e236d-ce0c-44ad-9f2c-ca59594911da admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.031389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e236d-ce0c-44ad-9f2c-ca59594911da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.032988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e236d-ce0c-44ad-9f2c-ca59594911da admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.038818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7469a61-9626-4e59-a1ac-e24fd5cd27e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90f628876264b8bac72381eb338c07e, user_id=c23e90a89ee8446593637aba3c106989, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.041436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7469a61-9626-4e59-a1ac-e24fd5cd27e1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.042497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 798/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.043316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e236d-ce0c-44ad-9f2c-ca59594911da admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.054586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e236d-ce0c-44ad-9f2c-ca59594911da admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.054955 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 791/1589] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:20 2022] PUT /identity/v3/projects/f90f628876264b8bac72381eb338c07e/users/c23e90a89ee8446593637aba3c106989/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:20.064647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469a61-9626-4e59-a1ac-e24fd5cd27e1 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.107894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa955d-bbde-4f88-b8ec-854fee7d706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.109334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa955d-bbde-4f88-b8ec-854fee7d706d admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.109645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa955d-bbde-4f88-b8ec-854fee7d706d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.109925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa955d-bbde-4f88-b8ec-854fee7d706d admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.110613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa955d-bbde-4f88-b8ec-854fee7d706d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.112552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa955d-bbde-4f88-b8ec-854fee7d706d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.116285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469a61-9626-4e59-a1ac-e24fd5cd27e1 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.120764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c19c-637e-42fd-b9bf-999f5450f49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.121436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c19c-637e-42fd-b9bf-999f5450f49a admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.121744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c19c-637e-42fd-b9bf-999f5450f49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.122021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c19c-637e-42fd-b9bf-999f5450f49a admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.122763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562c19c-637e-42fd-b9bf-999f5450f49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.124364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562c19c-637e-42fd-b9bf-999f5450f49a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.135405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 792/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.135405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c19c-637e-42fd-b9bf-999f5450f49a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.141474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 799/1591] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:20.141474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa955d-bbde-4f88-b8ec-854fee7d706d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.144827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c19c-637e-42fd-b9bf-999f5450f49a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.198317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa955d-bbde-4f88-b8ec-854fee7d706d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.199870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801a9d-e93a-4b80-b8f0-860f60fa5fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.200546 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801a9d-e93a-4b80-b8f0-860f60fa5fae admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.200829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801a9d-e93a-4b80-b8f0-860f60fa5fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.201104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50801a9d-e93a-4b80-b8f0-860f60fa5fae admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.202375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50801a9d-e93a-4b80-b8f0-860f60fa5fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.203544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218eede-accc-458a-9600-e0c72132d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.203961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50801a9d-e93a-4b80-b8f0-860f60fa5fae admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.204202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218eede-accc-458a-9600-e0c72132d7de admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.204485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218eede-accc-458a-9600-e0c72132d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.204761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218eede-accc-458a-9600-e0c72132d7de admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.205475 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218eede-accc-458a-9600-e0c72132d7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.207100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218eede-accc-458a-9600-e0c72132d7de admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.213412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 793/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.214313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801a9d-e93a-4b80-b8f0-860f60fa5fae admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.220015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 800/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.220015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218eede-accc-458a-9600-e0c72132d7de admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.224217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50801a9d-e93a-4b80-b8f0-860f60fa5fae admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.227257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218eede-accc-458a-9600-e0c72132d7de admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.228630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584a67-5a49-4ac4-98a5-72a27b7df023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.229265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584a67-5a49-4ac4-98a5-72a27b7df023 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.229632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584a67-5a49-4ac4-98a5-72a27b7df023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.229845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584a67-5a49-4ac4-98a5-72a27b7df023 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.230553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65584a67-5a49-4ac4-98a5-72a27b7df023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.231780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017557b-6734-49ea-bdc0-71404ddaad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.232105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65584a67-5a49-4ac4-98a5-72a27b7df023 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.232407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017557b-6734-49ea-bdc0-71404ddaad2c admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.232694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017557b-6734-49ea-bdc0-71404ddaad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.232963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017557b-6734-49ea-bdc0-71404ddaad2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.233732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017557b-6734-49ea-bdc0-71404ddaad2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.235282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017557b-6734-49ea-bdc0-71404ddaad2c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.242008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 794/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.242867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584a67-5a49-4ac4-98a5-72a27b7df023 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.247843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 801/1595] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.247843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e78b1d-388e-4314-8919-11d64234ae00 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.247843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e78b1d-388e-4314-8919-11d64234ae00 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.247843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e78b1d-388e-4314-8919-11d64234ae00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.252186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584a67-5a49-4ac4-98a5-72a27b7df023 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.256553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4666aba-793b-4655-a9fe-beaa7fa3dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.257187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4666aba-793b-4655-a9fe-beaa7fa3dba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.257468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4666aba-793b-4655-a9fe-beaa7fa3dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.257770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4666aba-793b-4655-a9fe-beaa7fa3dba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.258481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4666aba-793b-4655-a9fe-beaa7fa3dba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.260059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4666aba-793b-4655-a9fe-beaa7fa3dba1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.273654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 795/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.273654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4666aba-793b-4655-a9fe-beaa7fa3dba1 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.273925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-56e78b1d-388e-4314-8919-11d64234ae00 None None] MFA Rules not processed for user `c23e90a89ee8446593637aba3c106989`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:20.273925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-56e78b1d-388e-4314-8919-11d64234ae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:20.281029 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4666aba-793b-4655-a9fe-beaa7fa3dba1 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.285529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b8cde-f037-4f6a-8838-d329c1d9cb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.286181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8cde-f037-4f6a-8838-d329c1d9cb19 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.286460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8cde-f037-4f6a-8838-d329c1d9cb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.286733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8cde-f037-4f6a-8838-d329c1d9cb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.287428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b8cde-f037-4f6a-8838-d329c1d9cb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.288967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b8cde-f037-4f6a-8838-d329c1d9cb19 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.301518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 796/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.301518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b8cde-f037-4f6a-8838-d329c1d9cb19 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.310388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b8cde-f037-4f6a-8838-d329c1d9cb19 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.315170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d63b-6aa1-410d-a098-c71e777bbd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.315859 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d63b-6aa1-410d-a098-c71e777bbd9c admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.316398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d63b-6aa1-410d-a098-c71e777bbd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.316671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0d63b-6aa1-410d-a098-c71e777bbd9c admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.317343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0d63b-6aa1-410d-a098-c71e777bbd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.319285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0d63b-6aa1-410d-a098-c71e777bbd9c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.334981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 802/1598] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:20.335885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e78b1d-388e-4314-8919-11d64234ae00 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.343944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 797/1599] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/users => generated 308 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:20.346384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e78b1d-388e-4314-8919-11d64234ae00 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.347077 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d63b-6aa1-410d-a098-c71e777bbd9c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.351077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54da810-1ae0-4cb4-b774-52cbea711316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.351744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54da810-1ae0-4cb4-b774-52cbea711316 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.352032 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54da810-1ae0-4cb4-b774-52cbea711316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.352312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54da810-1ae0-4cb4-b774-52cbea711316 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.353029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54da810-1ae0-4cb4-b774-52cbea711316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.354665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54da810-1ae0-4cb4-b774-52cbea711316 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.357088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0d63b-6aa1-410d-a098-c71e777bbd9c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.362181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60326155-cddc-4abe-9334-d11bb9275fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.362838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60326155-cddc-4abe-9334-d11bb9275fee admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.363127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60326155-cddc-4abe-9334-d11bb9275fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.363406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60326155-cddc-4abe-9334-d11bb9275fee admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.364130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60326155-cddc-4abe-9334-d11bb9275fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.368287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 803/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.368451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60326155-cddc-4abe-9334-d11bb9275fee admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.368552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54da810-1ae0-4cb4-b774-52cbea711316 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.375266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54da810-1ae0-4cb4-b774-52cbea711316 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.376471 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 798/1601] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.377366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60326155-cddc-4abe-9334-d11bb9275fee admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.380203 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e0f3-b963-4fa9-9535-d243bcd55252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.381064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e0f3-b963-4fa9-9535-d243bcd55252 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.381349 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e0f3-b963-4fa9-9535-d243bcd55252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.381658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e0f3-b963-4fa9-9535-d243bcd55252 admin admin] PATH_INFO: `/v3/projects/8fd00b81b3b847a19533a7566fda02f6/users/16b9184129754c5e9eae0761124c9a47/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.386806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60326155-cddc-4abe-9334-d11bb9275fee admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.391875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a4c75-e2ef-4a2f-b577-fb3b5e06a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.392732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a4c75-e2ef-4a2f-b577-fb3b5e06a863 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.393016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a4c75-e2ef-4a2f-b577-fb3b5e06a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.393294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a4c75-e2ef-4a2f-b577-fb3b5e06a863 admin admin] PATH_INFO: `/v3/projects/5100c1cfe7f148058734c0da2d1497d4/users/cb70f7eb7b44487a9ee3f331c83f9e31/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.396345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670e0f3-b963-4fa9-9535-d243bcd55252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd00b81b3b847a19533a7566fda02f6, user_id=16b9184129754c5e9eae0761124c9a47, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.399088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670e0f3-b963-4fa9-9535-d243bcd55252 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.408288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a4c75-e2ef-4a2f-b577-fb3b5e06a863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5100c1cfe7f148058734c0da2d1497d4, user_id=cb70f7eb7b44487a9ee3f331c83f9e31, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.411092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a4c75-e2ef-4a2f-b577-fb3b5e06a863 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.412591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 804/1602] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:20 2022] PUT /identity/v3/projects/8fd00b81b3b847a19533a7566fda02f6/users/16b9184129754c5e9eae0761124c9a47/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:20.413449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e0f3-b963-4fa9-9535-d243bcd55252 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.424800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 799/1603] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:20 2022] PUT /identity/v3/projects/5100c1cfe7f148058734c0da2d1497d4/users/cb70f7eb7b44487a9ee3f331c83f9e31/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:20.425435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a4c75-e2ef-4a2f-b577-fb3b5e06a863 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.476654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e0f3-b963-4fa9-9535-d243bcd55252 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.482035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cb4b6-2844-409a-ae5d-bb0c7267bf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.482300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb4b6-2844-409a-ae5d-bb0c7267bf68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.482577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb4b6-2844-409a-ae5d-bb0c7267bf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.482846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cb4b6-2844-409a-ae5d-bb0c7267bf68 admin admin] PATH_INFO: `/v3/projects/96ac52de89f14d7995335a0d2c06ed8c/users/3d8e948ae270457a8a9b6197f6a02394/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.487252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a4c75-e2ef-4a2f-b577-fb3b5e06a863 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.491890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20895bed-67c5-46a7-a74d-bda7b39b1f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.492780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895bed-67c5-46a7-a74d-bda7b39b1f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.493066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895bed-67c5-46a7-a74d-bda7b39b1f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.493359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895bed-67c5-46a7-a74d-bda7b39b1f6c admin admin] PATH_INFO: `/v3/projects/1f8cf9d79fdd4e3a8b46fb3022a12a9f/users/f45a14e589ba491f90452d8923620358/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.496859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cb4b6-2844-409a-ae5d-bb0c7267bf68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ac52de89f14d7995335a0d2c06ed8c, user_id=3d8e948ae270457a8a9b6197f6a02394, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.499620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cb4b6-2844-409a-ae5d-bb0c7267bf68 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.508514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20895bed-67c5-46a7-a74d-bda7b39b1f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8cf9d79fdd4e3a8b46fb3022a12a9f, user_id=f45a14e589ba491f90452d8923620358, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.511389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20895bed-67c5-46a7-a74d-bda7b39b1f6c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.513456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 805/1604] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:20 2022] PUT /identity/v3/projects/96ac52de89f14d7995335a0d2c06ed8c/users/3d8e948ae270457a8a9b6197f6a02394/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:20.514247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cb4b6-2844-409a-ae5d-bb0c7267bf68 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.524967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 800/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:20 2022] PUT /identity/v3/projects/1f8cf9d79fdd4e3a8b46fb3022a12a9f/users/f45a14e589ba491f90452d8923620358/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:20.526014 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20895bed-67c5-46a7-a74d-bda7b39b1f6c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.574335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cb4b6-2844-409a-ae5d-bb0c7267bf68 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.580266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20895bed-67c5-46a7-a74d-bda7b39b1f6c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.583917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621426ed-1fc7-4596-8d31-f05eec414b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.584555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621426ed-1fc7-4596-8d31-f05eec414b65 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.584839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621426ed-1fc7-4596-8d31-f05eec414b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.585111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621426ed-1fc7-4596-8d31-f05eec414b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.628654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcefda-b9b0-4f09-9246-981bfc52a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.629319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcefda-b9b0-4f09-9246-981bfc52a803 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.629623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcefda-b9b0-4f09-9246-981bfc52a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.629900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcefda-b9b0-4f09-9246-981bfc52a803 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.630643 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcefda-b9b0-4f09-9246-981bfc52a803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.632233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcefda-b9b0-4f09-9246-981bfc52a803 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.639056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621426ed-1fc7-4596-8d31-f05eec414b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.641283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621426ed-1fc7-4596-8d31-f05eec414b65 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.642321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 806/1606] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:20.643132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcefda-b9b0-4f09-9246-981bfc52a803 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.650994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 801/1607] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:20.651936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621426ed-1fc7-4596-8d31-f05eec414b65 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.652580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcefda-b9b0-4f09-9246-981bfc52a803 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.658527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da6b12-0018-4275-bd56-9fed2a5ba472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.659484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da6b12-0018-4275-bd56-9fed2a5ba472 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.659760 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da6b12-0018-4275-bd56-9fed2a5ba472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.660033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da6b12-0018-4275-bd56-9fed2a5ba472 admin admin] PATH_INFO: `/v3/projects/7ab350046da947ad8a85d432e688c79d/users/8b33fd914df74e479497ce37cee6db51/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.663975 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621426ed-1fc7-4596-8d31-f05eec414b65 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.668706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed147bd-e0dd-46e4-b677-07a26cdf687e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.669616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed147bd-e0dd-46e4-b677-07a26cdf687e admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.669907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed147bd-e0dd-46e4-b677-07a26cdf687e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.670187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed147bd-e0dd-46e4-b677-07a26cdf687e admin admin] PATH_INFO: `/v3/projects/075ba180d52b46ad9cd3334520bcfb89/users/c6bb9dabb1fc46dda1fe1906ab248c57/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.676830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da6b12-0018-4275-bd56-9fed2a5ba472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab350046da947ad8a85d432e688c79d, user_id=8b33fd914df74e479497ce37cee6db51, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.679622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da6b12-0018-4275-bd56-9fed2a5ba472 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.685882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed147bd-e0dd-46e4-b677-07a26cdf687e admin admin] RBAC: Authorizing `identity:create_grant(project_id=075ba180d52b46ad9cd3334520bcfb89, user_id=c6bb9dabb1fc46dda1fe1906ab248c57, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.689382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed147bd-e0dd-46e4-b677-07a26cdf687e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.694292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 807/1608] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:20 2022] PUT /identity/v3/projects/7ab350046da947ad8a85d432e688c79d/users/8b33fd914df74e479497ce37cee6db51/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:20.695805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9c933-e353-4495-9046-491c9da7d79b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.696094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9c933-e353-4495-9046-491c9da7d79b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.696391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9c933-e353-4495-9046-491c9da7d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.707569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 802/1609] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:20 2022] PUT /identity/v3/projects/075ba180d52b46ad9cd3334520bcfb89/users/c6bb9dabb1fc46dda1fe1906ab248c57/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:20.707569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea62db-3461-4dd1-8ce6-de845b4a836e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.707569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea62db-3461-4dd1-8ce6-de845b4a836e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.707569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea62db-3461-4dd1-8ce6-de845b4a836e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.724059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3eea62db-3461-4dd1-8ce6-de845b4a836e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:20.725355 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3eea62db-3461-4dd1-8ce6-de845b4a836e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:20.725777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-efd9c933-e353-4495-9046-491c9da7d79b None None] MFA Rules not processed for user `16b9184129754c5e9eae0761124c9a47`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:20.726985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-efd9c933-e353-4495-9046-491c9da7d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:20.785169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 803/1610] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:20.786897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867d6e-f977-48bd-a483-386918a3df2b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.787257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867d6e-f977-48bd-a483-386918a3df2b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.787605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2867d6e-f977-48bd-a483-386918a3df2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.807278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 808/1611] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:20.810902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af6eb-04ed-4a1b-a50f-e876d4da9040 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.810902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af6eb-04ed-4a1b-a50f-e876d4da9040 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.810902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905af6eb-04ed-4a1b-a50f-e876d4da9040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.812470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b2867d6e-f977-48bd-a483-386918a3df2b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:20.813823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b2867d6e-f977-48bd-a483-386918a3df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:20.822595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 804/1612] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:20.824112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867d6e-f977-48bd-a483-386918a3df2b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:20.835219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2867d6e-f977-48bd-a483-386918a3df2b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:20.840168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab5337-9653-4e3d-9bce-d5d6ee2c9e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:20.840430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-905af6eb-04ed-4a1b-a50f-e876d4da9040 None None] MFA Rules not processed for user `f45a14e589ba491f90452d8923620358`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:20.841264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5337-9653-4e3d-9bce-d5d6ee2c9e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.841655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5337-9653-4e3d-9bce-d5d6ee2c9e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.841920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-905af6eb-04ed-4a1b-a50f-e876d4da9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:20.842066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab5337-9653-4e3d-9bce-d5d6ee2c9e3d admin admin] PATH_INFO: `/v3/projects/0dec783fd9794907b1ecc292b4ba4365/users/28757d337a974347b78f88102978bd32/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.858317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5337-9653-4e3d-9bce-d5d6ee2c9e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dec783fd9794907b1ecc292b4ba4365, user_id=28757d337a974347b78f88102978bd32, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:20.861154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab5337-9653-4e3d-9bce-d5d6ee2c9e3d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:20.879141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 805/1613] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:20 2022] PUT /identity/v3/projects/0dec783fd9794907b1ecc292b4ba4365/users/28757d337a974347b78f88102978bd32/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:20.880858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c35f3-6c16-4d9d-b577-9bbeb01250c5 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.881417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c35f3-6c16-4d9d-b577-9bbeb01250c5 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.881876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c35f3-6c16-4d9d-b577-9bbeb01250c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.911730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c91c35f3-6c16-4d9d-b577-9bbeb01250c5 None None] MFA Rules not processed for user `8b33fd914df74e479497ce37cee6db51`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:20.913196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c91c35f3-6c16-4d9d-b577-9bbeb01250c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:20.918334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 809/1614] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:20.919745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f07d8-8479-42a6-a425-4877d300a0ce None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:20.920037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f07d8-8479-42a6-a425-4877d300a0ce None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:20.920313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f07d8-8479-42a6-a425-4877d300a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:20.944246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ce3f07d8-8479-42a6-a425-4877d300a0ce None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:20.945440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ce3f07d8-8479-42a6-a425-4877d300a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:20.989997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 806/1615] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:20.990643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c35f3-6c16-4d9d-b577-9bbeb01250c5 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.007132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 810/1616] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:21.008127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f07d8-8479-42a6-a425-4877d300a0ce None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.061771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c35f3-6c16-4d9d-b577-9bbeb01250c5 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.067089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d41bbe-afee-4ec3-b0fa-eab3e95ef846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.067845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d41bbe-afee-4ec3-b0fa-eab3e95ef846 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.068246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d41bbe-afee-4ec3-b0fa-eab3e95ef846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.068620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d41bbe-afee-4ec3-b0fa-eab3e95ef846 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.069022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f07d8-8479-42a6-a425-4877d300a0ce None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.069556 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d41bbe-afee-4ec3-b0fa-eab3e95ef846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.071614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d41bbe-afee-4ec3-b0fa-eab3e95ef846 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.072809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f06361-c7ef-4475-b060-188f4ed6e50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.073396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f06361-c7ef-4475-b060-188f4ed6e50d service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.073712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f06361-c7ef-4475-b060-188f4ed6e50d service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.073992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f06361-c7ef-4475-b060-188f4ed6e50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.083179 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f06361-c7ef-4475-b060-188f4ed6e50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.084721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f06361-c7ef-4475-b060-188f4ed6e50d service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.095659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 811/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:21.096946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f06361-c7ef-4475-b060-188f4ed6e50d service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.101754 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 807/1618] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:20 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:21.102952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d41bbe-afee-4ec3-b0fa-eab3e95ef846 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.106500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f06361-c7ef-4475-b060-188f4ed6e50d service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.169639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea993ef-85a9-4feb-a7eb-b59ba8ca049f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.170342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea993ef-85a9-4feb-a7eb-b59ba8ca049f service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.171814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea993ef-85a9-4feb-a7eb-b59ba8ca049f service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.172100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea993ef-85a9-4feb-a7eb-b59ba8ca049f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.177188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d41bbe-afee-4ec3-b0fa-eab3e95ef846 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.182932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.183568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea993ef-85a9-4feb-a7eb-b59ba8ca049f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.184164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.184607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.185028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.185144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea993ef-85a9-4feb-a7eb-b59ba8ca049f service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.185972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.188264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.196887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 812/1619] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:21.198636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0fc62-dfc3-492f-96c8-68883b800391 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.199081 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0fc62-dfc3-492f-96c8-68883b800391 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.199221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0fc62-dfc3-492f-96c8-68883b800391 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.200772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 813/1620] 10.222.0.36 () {54 vars in 961 bytes} [Wed May 11 07:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:21.201702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0fc62-dfc3-492f-96c8-68883b800391 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.213374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 808/1621] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:21.214356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.216459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0fc62-dfc3-492f-96c8-68883b800391 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.217815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:21.222079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9a3f2-9f4e-4e11-98da-5a067427c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.222864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9a3f2-9f4e-4e11-98da-5a067427c173 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.223255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9a3f2-9f4e-4e11-98da-5a067427c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.223625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9a3f2-9f4e-4e11-98da-5a067427c173 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.224539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9a3f2-9f4e-4e11-98da-5a067427c173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.226660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9a3f2-9f4e-4e11-98da-5a067427c173 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.261386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f705-8279-402c-b773-aeda84fac2c6 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.276830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 814/1622] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:21 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:21.277679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9a3f2-9f4e-4e11-98da-5a067427c173 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.278973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96566bc0-0b78-4d51-bb12-2356acf7f44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.279739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96566bc0-0b78-4d51-bb12-2356acf7f44e service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.280158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96566bc0-0b78-4d51-bb12-2356acf7f44e service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.280534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96566bc0-0b78-4d51-bb12-2356acf7f44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.294261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96566bc0-0b78-4d51-bb12-2356acf7f44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.297358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96566bc0-0b78-4d51-bb12-2356acf7f44e service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.317951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 809/1623] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:21.335931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b47ccd-4551-4425-adf2-6cf8105ee990 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.336236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b47ccd-4551-4425-adf2-6cf8105ee990 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.336529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b47ccd-4551-4425-adf2-6cf8105ee990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.382517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-97b47ccd-4551-4425-adf2-6cf8105ee990 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:21.383848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-97b47ccd-4551-4425-adf2-6cf8105ee990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:21.410183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9a3f2-9f4e-4e11-98da-5a067427c173 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.417370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc03fc-fb04-403f-b1c7-8e47544c853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.418205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc03fc-fb04-403f-b1c7-8e47544c853a admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.418588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc03fc-fb04-403f-b1c7-8e47544c853a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.419218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc03fc-fb04-403f-b1c7-8e47544c853a admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.420347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc03fc-fb04-403f-b1c7-8e47544c853a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.425785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc03fc-fb04-403f-b1c7-8e47544c853a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.457962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 815/1624] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:21 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:21.459868 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc03fc-fb04-403f-b1c7-8e47544c853a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.472161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc03fc-fb04-403f-b1c7-8e47544c853a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.472694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 810/1625] 10.222.0.36 () {58 vars in 1058 bytes} [Wed May 11 07:38:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:21.475508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b47ccd-4551-4425-adf2-6cf8105ee990 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.479537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d64a-d62b-4a36-a04d-782d1a0c8119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.481498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d64a-d62b-4a36-a04d-782d1a0c8119 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.481741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d64a-d62b-4a36-a04d-782d1a0c8119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.482103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383d64a-d62b-4a36-a04d-782d1a0c8119 admin admin] PATH_INFO: `/v3/projects/0dec783fd9794907b1ecc292b4ba4365/users/28757d337a974347b78f88102978bd32/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.490687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383d64a-d62b-4a36-a04d-782d1a0c8119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dec783fd9794907b1ecc292b4ba4365, user_id=28757d337a974347b78f88102978bd32, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.494384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383d64a-d62b-4a36-a04d-782d1a0c8119 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.515086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 816/1626] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:21 2022] PUT /identity/v3/projects/0dec783fd9794907b1ecc292b4ba4365/users/28757d337a974347b78f88102978bd32/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:21.516481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d64a-d62b-4a36-a04d-782d1a0c8119 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.539100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b47ccd-4551-4425-adf2-6cf8105ee990 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.604370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383d64a-d62b-4a36-a04d-782d1a0c8119 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.607579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501e095-4127-4f9a-b0d1-5bf2f3484b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.608778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e095-4127-4f9a-b0d1-5bf2f3484b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.609165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e095-4127-4f9a-b0d1-5bf2f3484b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.609555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e095-4127-4f9a-b0d1-5bf2f3484b8a admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.610370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501e095-4127-4f9a-b0d1-5bf2f3484b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.611781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c566c-6afc-4f6a-b74b-7ca16c39d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.612783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501e095-4127-4f9a-b0d1-5bf2f3484b8a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.612928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c566c-6afc-4f6a-b74b-7ca16c39d0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.613309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c566c-6afc-4f6a-b74b-7ca16c39d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.613772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c566c-6afc-4f6a-b74b-7ca16c39d0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.614954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c566c-6afc-4f6a-b74b-7ca16c39d0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.617161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c566c-6afc-4f6a-b74b-7ca16c39d0f7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.636212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 817/1627] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:21.636212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c566c-6afc-4f6a-b74b-7ca16c39d0f7 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.640411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 811/1628] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:21 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:21.642120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b30e-6ac6-4f96-b62b-c339c6389aee None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.642628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b30e-6ac6-4f96-b62b-c339c6389aee None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.643164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934b30e-6ac6-4f96-b62b-c339c6389aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.676536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5934b30e-6ac6-4f96-b62b-c339c6389aee None None] MFA Rules not processed for user `28757d337a974347b78f88102978bd32`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:21.679183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5934b30e-6ac6-4f96-b62b-c339c6389aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:21.737441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c566c-6afc-4f6a-b74b-7ca16c39d0f7 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.767604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979bfa9-bb7b-4d7c-8502-252c7e80c01b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.768342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bfa9-bb7b-4d7c-8502-252c7e80c01b service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.768631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bfa9-bb7b-4d7c-8502-252c7e80c01b service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.768905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bfa9-bb7b-4d7c-8502-252c7e80c01b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.787969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 812/1629] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:21.789290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934b30e-6ac6-4f96-b62b-c339c6389aee None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.820092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934b30e-6ac6-4f96-b62b-c339c6389aee None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:21.828262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfaaf2-5eee-474d-b473-a7c46023ac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:21.829974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfaaf2-5eee-474d-b473-a7c46023ac3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:21.830949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfaaf2-5eee-474d-b473-a7c46023ac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:21.831260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfaaf2-5eee-474d-b473-a7c46023ac3d admin admin] PATH_INFO: `/v3/projects/c2964d09955a428388d42f48beef4062/users/bfdedd85a44445b8914fa73de104c5a1/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:21.863646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfaaf2-5eee-474d-b473-a7c46023ac3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2964d09955a428388d42f48beef4062, user_id=bfdedd85a44445b8914fa73de104c5a1, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.867606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfaaf2-5eee-474d-b473-a7c46023ac3d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.899683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 813/1630] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:21 2022] PUT /identity/v3/projects/c2964d09955a428388d42f48beef4062/users/bfdedd85a44445b8914fa73de104c5a1/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:21.901823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfaaf2-5eee-474d-b473-a7c46023ac3d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:21.903837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979bfa9-bb7b-4d7c-8502-252c7e80c01b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:21.906888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979bfa9-bb7b-4d7c-8502-252c7e80c01b service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:21.945267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 818/1631] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:21.946783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979bfa9-bb7b-4d7c-8502-252c7e80c01b service nova] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:22.027323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfaaf2-5eee-474d-b473-a7c46023ac3d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:22.035365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fad57-e528-4b75-a832-ffcea63e4764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:22.036049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fad57-e528-4b75-a832-ffcea63e4764 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.036376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fad57-e528-4b75-a832-ffcea63e4764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.036657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fad57-e528-4b75-a832-ffcea63e4764 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.037667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fad57-e528-4b75-a832-ffcea63e4764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:22.039695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fad57-e528-4b75-a832-ffcea63e4764 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:22.060268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 814/1632] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:22.060268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fad57-e528-4b75-a832-ffcea63e4764 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:22.073378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fad57-e528-4b75-a832-ffcea63e4764 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:22.078877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979bfa9-bb7b-4d7c-8502-252c7e80c01b service nova] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:22.086076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5dcc6-b725-46da-9ee1-8e5d1edd2ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:22.098888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dcc6-b725-46da-9ee1-8e5d1edd2ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.098888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dcc6-b725-46da-9ee1-8e5d1edd2ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.098888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dcc6-b725-46da-9ee1-8e5d1edd2ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.098888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5dcc6-b725-46da-9ee1-8e5d1edd2ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:22.099722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5dcc6-b725-46da-9ee1-8e5d1edd2ee5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:22.140289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 815/1633] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:22.141577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5dcc6-b725-46da-9ee1-8e5d1edd2ee5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:22.190200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5dcc6-b725-46da-9ee1-8e5d1edd2ee5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:22.196883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b867e-081b-46ae-bdad-7d9cb62ef1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:22.198010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b867e-081b-46ae-bdad-7d9cb62ef1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.198790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b867e-081b-46ae-bdad-7d9cb62ef1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.199084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b867e-081b-46ae-bdad-7d9cb62ef1d6 admin admin] PATH_INFO: `/v3/projects/d7eab63757454afcbfd94be11cbc2f75/users/66091ed9e8ff4a68a34a602fe83b927c/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.199497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cf52b-4334-40a8-83ac-84235268deb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:22.200939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf52b-4334-40a8-83ac-84235268deb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.201573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf52b-4334-40a8-83ac-84235268deb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.203453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf52b-4334-40a8-83ac-84235268deb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.235123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b867e-081b-46ae-bdad-7d9cb62ef1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7eab63757454afcbfd94be11cbc2f75, user_id=66091ed9e8ff4a68a34a602fe83b927c, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:22.243028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b867e-081b-46ae-bdad-7d9cb62ef1d6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:22.276088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 816/1634] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:22 2022] PUT /identity/v3/projects/d7eab63757454afcbfd94be11cbc2f75/users/66091ed9e8ff4a68a34a602fe83b927c/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:22.278998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b867e-081b-46ae-bdad-7d9cb62ef1d6 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:22.299736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cf52b-4334-40a8-83ac-84235268deb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:22.302694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cf52b-4334-40a8-83ac-84235268deb7 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:22.328351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 819/1635] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:22.329919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cf52b-4334-40a8-83ac-84235268deb7 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:22.345184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cf52b-4334-40a8-83ac-84235268deb7 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:22.400544 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b867e-081b-46ae-bdad-7d9cb62ef1d6 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:22.409298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679133f5-a160-4885-b465-bca95fe5bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:22.411447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679133f5-a160-4885-b465-bca95fe5bf92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.412389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679133f5-a160-4885-b465-bca95fe5bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.413455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679133f5-a160-4885-b465-bca95fe5bf92 admin admin] PATH_INFO: `/v3/projects/c2964d09955a428388d42f48beef4062/users/bfdedd85a44445b8914fa73de104c5a1/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.426006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679133f5-a160-4885-b465-bca95fe5bf92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2964d09955a428388d42f48beef4062, user_id=bfdedd85a44445b8914fa73de104c5a1, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:22.438340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679133f5-a160-4885-b465-bca95fe5bf92 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:22.478021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 817/1636] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:22 2022] PUT /identity/v3/projects/c2964d09955a428388d42f48beef4062/users/bfdedd85a44445b8914fa73de104c5a1/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:22.489915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281468-6e9f-4d5e-bcdf-6780f664fdd7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.490563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281468-6e9f-4d5e-bcdf-6780f664fdd7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.491028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281468-6e9f-4d5e-bcdf-6780f664fdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.551042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951f834-e6e9-4374-9a41-2a69642995fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:22.551887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951f834-e6e9-4374-9a41-2a69642995fc admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.552172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951f834-e6e9-4374-9a41-2a69642995fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.554338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951f834-e6e9-4374-9a41-2a69642995fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.555103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951f834-e6e9-4374-9a41-2a69642995fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:22.556712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951f834-e6e9-4374-9a41-2a69642995fc admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:22.565235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f1281468-6e9f-4d5e-bcdf-6780f664fdd7 None None] MFA Rules not processed for user `bfdedd85a44445b8914fa73de104c5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:22.566809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f1281468-6e9f-4d5e-bcdf-6780f664fdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:22.587849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 820/1637] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:22.591340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f587e-7be3-41fc-ad94-4b224a10ef80 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.591633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f587e-7be3-41fc-ad94-4b224a10ef80 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.594044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f587e-7be3-41fc-ad94-4b224a10ef80 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.601734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 821/1638] 10.222.0.36 () {54 vars in 912 bytes} [Wed May 11 07:38:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:22.602636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f587e-7be3-41fc-ad94-4b224a10ef80 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:22.688057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 818/1639] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:22.689219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593b3d8-c14a-44de-b3c7-3404b7585759 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.689509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593b3d8-c14a-44de-b3c7-3404b7585759 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.689815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593b3d8-c14a-44de-b3c7-3404b7585759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.746591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2593b3d8-c14a-44de-b3c7-3404b7585759 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:22.747840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2593b3d8-c14a-44de-b3c7-3404b7585759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:22.793605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f587e-7be3-41fc-ad94-4b224a10ef80 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:22.804485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220cec5-e47a-4f6a-9f0f-bacf50aaffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:22.805401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220cec5-e47a-4f6a-9f0f-bacf50aaffc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.805744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220cec5-e47a-4f6a-9f0f-bacf50aaffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.806440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220cec5-e47a-4f6a-9f0f-bacf50aaffc5 admin admin] PATH_INFO: `/v3/projects/d7eab63757454afcbfd94be11cbc2f75/users/66091ed9e8ff4a68a34a602fe83b927c/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.813252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220cec5-e47a-4f6a-9f0f-bacf50aaffc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7eab63757454afcbfd94be11cbc2f75, user_id=66091ed9e8ff4a68a34a602fe83b927c, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:22.840516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220cec5-e47a-4f6a-9f0f-bacf50aaffc5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:22.870609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 822/1640] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:22 2022] PUT /identity/v3/projects/d7eab63757454afcbfd94be11cbc2f75/users/66091ed9e8ff4a68a34a602fe83b927c/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:22.872022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220cec5-e47a-4f6a-9f0f-bacf50aaffc5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:22.885659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 819/1641] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:38:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:22.886791 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0bbf-a6eb-4975-b265-9384c334e9b7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:22.887087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0bbf-a6eb-4975-b265-9384c334e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:22.887365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad0bbf-a6eb-4975-b265-9384c334e9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:22.953813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b2ad0bbf-a6eb-4975-b265-9384c334e9b7 None None] MFA Rules not processed for user `66091ed9e8ff4a68a34a602fe83b927c`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:22.957939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b2ad0bbf-a6eb-4975-b265-9384c334e9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:23.001800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220cec5-e47a-4f6a-9f0f-bacf50aaffc5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:23.007148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e81d-56c1-493d-a6f1-131b2db58e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:23.009022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e81d-56c1-493d-a6f1-131b2db58e55 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.009381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e81d-56c1-493d-a6f1-131b2db58e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.010340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442e81d-56c1-493d-a6f1-131b2db58e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.084148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 820/1642] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:23.085396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0bbf-a6eb-4975-b265-9384c334e9b7 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:23.104063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442e81d-56c1-493d-a6f1-131b2db58e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:23.105814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442e81d-56c1-493d-a6f1-131b2db58e55 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:23.120818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 823/1643] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:23.121871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e81d-56c1-493d-a6f1-131b2db58e55 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:23.131510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442e81d-56c1-493d-a6f1-131b2db58e55 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:23.135905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafd151-8020-4cf4-b58c-b58c92937f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:23.136637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd151-8020-4cf4-b58c-b58c92937f5d service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.136994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd151-8020-4cf4-b58c-b58c92937f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.137481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd151-8020-4cf4-b58c-b58c92937f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.207252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad0bbf-a6eb-4975-b265-9384c334e9b7 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:23.229376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:23.231255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.232080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.232724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] PATH_INFO: `/v3/users/34cde8fce4dc46e39baeb4ec37fa20a0` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.236445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafd151-8020-4cf4-b58c-b58c92937f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:23.237338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cde8fce4dc46e39baeb4ec37fa20a0)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:23.239436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafd151-8020-4cf4-b58c-b58c92937f5d service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:23.242199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: WARNING py.warnings [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:38:23.242199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: warnings.warn(msg) May 11 07:38:23.242199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: May 11 07:38:23.244243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:23.259425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 824/1644] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:23.261007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774306-ba12-4eda-8ee5-c00d18c9f36c None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.261359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774306-ba12-4eda-8ee5-c00d18c9f36c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.261714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25774306-ba12-4eda-8ee5-c00d18c9f36c None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.265103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 825/1645] 10.222.0.36 () {54 vars in 961 bytes} [Wed May 11 07:38:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:23.265970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25774306-ba12-4eda-8ee5-c00d18c9f36c None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:23.289484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25774306-ba12-4eda-8ee5-c00d18c9f36c None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:23.293968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2062a2-ef72-4cdd-a6d2-5236b982ae82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:23.294741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2062a2-ef72-4cdd-a6d2-5236b982ae82 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.295101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2062a2-ef72-4cdd-a6d2-5236b982ae82 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.295597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2062a2-ef72-4cdd-a6d2-5236b982ae82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.321440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2062a2-ef72-4cdd-a6d2-5236b982ae82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:23.322923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2062a2-ef72-4cdd-a6d2-5236b982ae82 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:23.344901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 826/1646] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:23.346311 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650467a8-cb1d-4ffe-9f7c-ca95a0bc2b49 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.346586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650467a8-cb1d-4ffe-9f7c-ca95a0bc2b49 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.346853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650467a8-cb1d-4ffe-9f7c-ca95a0bc2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.386150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-650467a8-cb1d-4ffe-9f7c-ca95a0bc2b49 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:23.387354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-650467a8-cb1d-4ffe-9f7c-ca95a0bc2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:23.401001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cde8fce4dc46e39baeb4ec37fa20a0'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:23.407381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 827/1647] 10.222.0.36 () {58 vars in 1058 bytes} [Wed May 11 07:38:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:23.413142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a60648-a7fe-4ac9-a499-0a0df639d63e None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.413428 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a60648-a7fe-4ac9-a499-0a0df639d63e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.413734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a60648-a7fe-4ac9-a499-0a0df639d63e None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.415367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 828/1648] 10.222.0.36 () {54 vars in 912 bytes} [Wed May 11 07:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 07:38:23.423142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca255e7-5e41-44e1-9e9f-82c004af82c1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.423427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca255e7-5e41-44e1-9e9f-82c004af82c1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.423703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca255e7-5e41-44e1-9e9f-82c004af82c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.435144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cde8fce4dc46e39baeb4ec37fa20a0'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:23.436109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cde8fce4dc46e39baeb4ec37fa20a0'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:23.448254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cde8fce4dc46e39baeb4ec37fa20a0'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:23.449262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fcda6438-a9e0-4669-b2c3-f9df8efd4a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cde8fce4dc46e39baeb4ec37fa20a0'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:23.455815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-5ca255e7-5e41-44e1-9e9f-82c004af82c1 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:23.457656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5ca255e7-5e41-44e1-9e9f-82c004af82c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:23.477324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 821/1649] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:23 2022] DELETE /identity/v3/users/34cde8fce4dc46e39baeb4ec37fa20a0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:23.482305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00723a0-3e3e-49b0-9403-3b131b80b63e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.482769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00723a0-3e3e-49b0-9403-3b131b80b63e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.485229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00723a0-3e3e-49b0-9403-3b131b80b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.488333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 829/1650] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:38:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:23.507470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2011af-7fce-48aa-ab4f-97e5c7301b1d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.508116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2011af-7fce-48aa-ab4f-97e5c7301b1d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.508798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2011af-7fce-48aa-ab4f-97e5c7301b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.523232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e00723a0-3e3e-49b0-9403-3b131b80b63e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:23.534474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e00723a0-3e3e-49b0-9403-3b131b80b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:23.564462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-af2011af-7fce-48aa-ab4f-97e5c7301b1d None None] MFA Rules not processed for user `3d8e948ae270457a8a9b6197f6a02394`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:23.566448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-af2011af-7fce-48aa-ab4f-97e5c7301b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:23.719567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 822/1651] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:23.720835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 830/1652] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:23.727195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00723a0-3e3e-49b0-9403-3b131b80b63e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:23.729808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e00723a0-3e3e-49b0-9403-3b131b80b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:23.732960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce640-8a96-400a-86ef-c15c6f57b89b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.733255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce640-8a96-400a-86ef-c15c6f57b89b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.733553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ce640-8a96-400a-86ef-c15c6f57b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.767152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0e7ce640-8a96-400a-86ef-c15c6f57b89b None None] MFA Rules not processed for user `3d8e948ae270457a8a9b6197f6a02394`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:23.768431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0e7ce640-8a96-400a-86ef-c15c6f57b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:23.786408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 831/1653] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:23.788713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ce640-8a96-400a-86ef-c15c6f57b89b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:23.790833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0e7ce640-8a96-400a-86ef-c15c6f57b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:23.890193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00723a0-3e3e-49b0-9403-3b131b80b63e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:23.912409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:23.913867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.914192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.915612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.932499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ce640-8a96-400a-86ef-c15c6f57b89b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:23.939262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:23.939852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:23.940187 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:23.940465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:23.966147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:23.968071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:24.004858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 832/1654] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:24.015310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:24.017642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:24.036993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897191-828f-4daf-b7c9-17370d572d38 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:24.045180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:24.048560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:24.048560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:24.048560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:24.053406 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:24.075962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:24.079311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:24.102152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 823/1655] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:24.166327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:24.169198 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:24.193708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 833/1656] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:24.243109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:24.245446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:24.279339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ae64f-20fc-4d7e-a2fc-aba992f8a6ed service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:24.300802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4216cc1-dbb5-42ea-b42e-b950aa4049a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:24.302136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4216cc1-dbb5-42ea-b42e-b950aa4049a8 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:24.303137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4216cc1-dbb5-42ea-b42e-b950aa4049a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:24.303939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4216cc1-dbb5-42ea-b42e-b950aa4049a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:24.327882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4216cc1-dbb5-42ea-b42e-b950aa4049a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:24.330878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4216cc1-dbb5-42ea-b42e-b950aa4049a8 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:24.356499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 824/1657] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:25.760924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:25.762907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:25.794729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcee1e-1a1e-4c68-8de5-d4ea5a4aa4ae service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:25.819862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:25.827685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:25.828423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:25.829989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] PATH_INFO: `/v3/projects/15328783fceb487482aa69d0d97ab95a` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:25.835707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15328783fceb487482aa69d0d97ab95a)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:25.839679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: WARNING py.warnings [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 07:38:25.839679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: warnings.warn(msg) May 11 07:38:25.839679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: May 11 07:38:25.841164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:26.010464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bc21b-0563-497a-93d6-68d5f0b7f499 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:26.010977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bc21b-0563-497a-93d6-68d5f0b7f499 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:26.011074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bc21b-0563-497a-93d6-68d5f0b7f499 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:26.012874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 825/1658] 10.222.0.36 () {54 vars in 912 bytes} [Wed May 11 07:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:26.019553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f5c1-5c38-475d-9ac7-a0575ef8c931 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:26.020057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f5c1-5c38-475d-9ac7-a0575ef8c931 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:26.020491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0f5c1-5c38-475d-9ac7-a0575ef8c931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:26.023935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15328783fceb487482aa69d0d97ab95a', 'request_id': 'req-8b97f572-12b3-415c-8ba5-192e2b4e1e89'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.040070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15328783fceb487482aa69d0d97ab95a', 'request_id': 'req-8b97f572-12b3-415c-8ba5-192e2b4e1e89'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.060192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15328783fceb487482aa69d0d97ab95a', 'request_id': 'req-8b97f572-12b3-415c-8ba5-192e2b4e1e89'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.130908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] The token cache is being invalidate because project 15328783fceb487482aa69d0d97ab95a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:26.130908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.132765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.139893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 834/1659] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:25 2022] DELETE /identity/v3/projects/15328783fceb487482aa69d0d97ab95a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:26.141063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e6f0f5c1-5c38-475d-9ac7-a0575ef8c931 None None] MFA Rules not processed for user `66b60e827f404e3891e4f24ca842e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:26.143504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:26.145085 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:26.151128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e6f0f5c1-5c38-475d-9ac7-a0575ef8c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:26.290840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 826/1660] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:38:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:26.292267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0f5c1-5c38-475d-9ac7-a0575ef8c931 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:26.294211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e6f0f5c1-5c38-475d-9ac7-a0575ef8c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:26.310087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f572-12b3-415c-8ba5-192e2b4e1e89 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:26.311024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0f5c1-5c38-475d-9ac7-a0575ef8c931 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:26.317104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:26.318398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:26.318854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:26.319440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] PATH_INFO: `/v3/users/8b33fd914df74e479497ce37cee6db51` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:26.320876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:26.322029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:26.322550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:26.322942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b33fd914df74e479497ce37cee6db51)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:26.323721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] PATH_INFO: `/v3/users/28757d337a974347b78f88102978bd32` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:26.330928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:26.332035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28757d337a974347b78f88102978bd32)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:26.337222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:26.421612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b33fd914df74e479497ce37cee6db51'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.437514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b33fd914df74e479497ce37cee6db51'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.442670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28757d337a974347b78f88102978bd32'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.446889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b33fd914df74e479497ce37cee6db51'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.459748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b33fd914df74e479497ce37cee6db51'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.461363 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b33fd914df74e479497ce37cee6db51'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.469280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28757d337a974347b78f88102978bd32'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.485554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 827/1661] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:26 2022] DELETE /identity/v3/users/8b33fd914df74e479497ce37cee6db51 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:26.486638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28757d337a974347b78f88102978bd32'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.486729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:26.488547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:26.490283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28757d337a974347b78f88102978bd32'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.509185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-86faab8d-0298-411f-8bff-e934768bac4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28757d337a974347b78f88102978bd32'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:26.524747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 835/1662] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:26 2022] DELETE /identity/v3/users/28757d337a974347b78f88102978bd32 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:38:26.526169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb2b22-41cd-426c-b8c1-abf823a8ce4e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:26.526464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb2b22-41cd-426c-b8c1-abf823a8ce4e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:26.526744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb2b22-41cd-426c-b8c1-abf823a8ce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:26.569912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ecfb2b22-41cd-426c-b8c1-abf823a8ce4e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:26.571324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ecfb2b22-41cd-426c-b8c1-abf823a8ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:26.604724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebdb0b-d4e3-41ea-b02d-a21b7278a1e3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:26.704308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 836/1663] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:26.715791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb2b22-41cd-426c-b8c1-abf823a8ce4e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:26.717471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ecfb2b22-41cd-426c-b8c1-abf823a8ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:26.737360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:26.738646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:26.739747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:26.744090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:26.747495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:26.769096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:26.770814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:26.797152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 828/1664] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:26.837766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb2b22-41cd-426c-b8c1-abf823a8ce4e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:26.837766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:26.837766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:26.837766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:26.838777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:26.863489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:26.865057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:26.876927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 837/1665] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:27.505335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:27.506898 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:27.546487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b465fb6-3d4c-4589-9ece-02491ae71fee service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:27.551320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:27.552296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:27.552656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:27.553057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] PATH_INFO: `/v3/projects/7ab350046da947ad8a85d432e688c79d` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:27.558134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab350046da947ad8a85d432e688c79d)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:27.562146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:27.703567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab350046da947ad8a85d432e688c79d', 'request_id': 'req-de53e7dc-6f3e-479a-9808-cac106a18c4d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:27.716211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab350046da947ad8a85d432e688c79d', 'request_id': 'req-de53e7dc-6f3e-479a-9808-cac106a18c4d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:27.735751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab350046da947ad8a85d432e688c79d', 'request_id': 'req-de53e7dc-6f3e-479a-9808-cac106a18c4d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:27.751241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:27.752807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:27.761685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] The token cache is being invalidate because project 7ab350046da947ad8a85d432e688c79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:27.762046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:27.764549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:27.769503 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 829/1666] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:27 2022] DELETE /identity/v3/projects/7ab350046da947ad8a85d432e688c79d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:27.770561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:27.775108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:27.784146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673bc1-5fdb-4a80-82a9-8f08efd81b55 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:27.969700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e7dc-6f3e-479a-9808-cac106a18c4d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:27.993294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:27.994224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:27.994514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:27.994798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] PATH_INFO: `/v3/users/66091ed9e8ff4a68a34a602fe83b927c` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:27.996633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:27.998146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] RBAC: Authorizing `identity:delete_user(user_id=66091ed9e8ff4a68a34a602fe83b927c)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:28.000529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.002123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.002331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] PATH_INFO: `/v3/projects/0dec783fd9794907b1ecc292b4ba4365` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.005943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dec783fd9794907b1ecc292b4ba4365)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:28.007538 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:28.011326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:28.135656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66091ed9e8ff4a68a34a602fe83b927c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.149052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dec783fd9794907b1ecc292b4ba4365', 'request_id': 'req-fa378fee-9acd-494b-9781-ae6a584ba31d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.159380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dec783fd9794907b1ecc292b4ba4365', 'request_id': 'req-fa378fee-9acd-494b-9781-ae6a584ba31d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.168242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66091ed9e8ff4a68a34a602fe83b927c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.169617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66091ed9e8ff4a68a34a602fe83b927c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.177736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dec783fd9794907b1ecc292b4ba4365', 'request_id': 'req-fa378fee-9acd-494b-9781-ae6a584ba31d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.195072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66091ed9e8ff4a68a34a602fe83b927c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.196773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-91b51e2b-d0d8-4a0d-973b-49266f12381b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66091ed9e8ff4a68a34a602fe83b927c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.205443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] The token cache is being invalidate because project 0dec783fd9794907b1ecc292b4ba4365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:28.206871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.209673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fa378fee-9acd-494b-9781-ae6a584ba31d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:28.212408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 838/1667] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:27 2022] DELETE /identity/v3/projects/0dec783fd9794907b1ecc292b4ba4365 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:28.214322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ee50f-9d4c-453b-922b-1dbabecd2d50 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.214929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ee50f-9d4c-453b-922b-1dbabecd2d50 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.215706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ee50f-9d4c-453b-922b-1dbabecd2d50 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.226272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 839/1668] 10.222.0.36 () {54 vars in 960 bytes} [Wed May 11 07:38:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:28.231844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 830/1669] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:27 2022] DELETE /identity/v3/users/66091ed9e8ff4a68a34a602fe83b927c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:38:28.234217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c712b-f874-4875-a6d0-ebc00dad348d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.235270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c865183-a7d3-4212-82f0-372b522d85aa None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.235726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c865183-a7d3-4212-82f0-372b522d85aa None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.236137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c865183-a7d3-4212-82f0-372b522d85aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.237019 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c712b-f874-4875-a6d0-ebc00dad348d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.237431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c712b-f874-4875-a6d0-ebc00dad348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.275726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4c865183-a7d3-4212-82f0-372b522d85aa None None] MFA Rules not processed for user `a1b36840995045199ec96eac939d5d35`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:28.278265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4c865183-a7d3-4212-82f0-372b522d85aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:28.278968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a61c712b-f874-4875-a6d0-ebc00dad348d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:28.283842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a61c712b-f874-4875-a6d0-ebc00dad348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:28.427061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 831/1670] 10.222.0.36 () {58 vars in 1057 bytes} [Wed May 11 07:38:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:28.428098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c865183-a7d3-4212-82f0-372b522d85aa None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:28.445319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 840/1671] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:28.447423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb037a-99ae-49da-8a7d-b6afccba62c1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.447752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb037a-99ae-49da-8a7d-b6afccba62c1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.448190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb037a-99ae-49da-8a7d-b6afccba62c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.468514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c865183-a7d3-4212-82f0-372b522d85aa None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:28.484260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:28.484996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.485290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.487939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.497486 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-43eb037a-99ae-49da-8a7d-b6afccba62c1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:28.499115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:28.503248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-43eb037a-99ae-49da-8a7d-b6afccba62c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:28.542445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 841/1672] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:28.542618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:28.545948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb037a-99ae-49da-8a7d-b6afccba62c1 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:28.549459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:28.571616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb037a-99ae-49da-8a7d-b6afccba62c1 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:28.596533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 832/1673] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:28.611766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:28.612462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.612748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.613027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.613802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:28.614117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:28.615744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:28.652755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 842/1674] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:28.658051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:28.674387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1646a5-14b9-43c5-b935-316006eb3d9c service placement] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:28.692245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ba16-4b16-4424-a6c4-d27f848aa4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:28.693196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ba16-4b16-4424-a6c4-d27f848aa4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.693647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ba16-4b16-4424-a6c4-d27f848aa4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.694059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ba16-4b16-4424-a6c4-d27f848aa4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.694909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024ba16-4b16-4424-a6c4-d27f848aa4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:28.696984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024ba16-4b16-4424-a6c4-d27f848aa4d8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:28.757895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 833/1675] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:28 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:38:28.762109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:28.775320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fc6ac-ecd8-4bfa-8ba8-fb8f3cd825a1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:28.843936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28d61-d3ee-4baa-bc91-db5e49644671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:28.844650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28d61-d3ee-4baa-bc91-db5e49644671 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.845143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28d61-d3ee-4baa-bc91-db5e49644671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.845429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28d61-d3ee-4baa-bc91-db5e49644671 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.846194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28d61-d3ee-4baa-bc91-db5e49644671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:28.848274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28d61-d3ee-4baa-bc91-db5e49644671 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:28.883607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 843/1676] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:28 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:28.887540 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ba16-4b16-4424-a6c4-d27f848aa4d8 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:28.899689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ba16-4b16-4424-a6c4-d27f848aa4d8 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:28.912212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df072a-732c-44c5-80f9-9dea2ce682c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:28.913083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df072a-732c-44c5-80f9-9dea2ce682c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.913439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df072a-732c-44c5-80f9-9dea2ce682c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.913975 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df072a-732c-44c5-80f9-9dea2ce682c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.914610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df072a-732c-44c5-80f9-9dea2ce682c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:28.916307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df072a-732c-44c5-80f9-9dea2ce682c0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:28.945897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28d61-d3ee-4baa-bc91-db5e49644671 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:28.954209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 834/1677] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:28.960556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28d61-d3ee-4baa-bc91-db5e49644671 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:28.974447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801013a2-ee6e-488a-9e87-8eb9fe4ab1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:28.975227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801013a2-ee6e-488a-9e87-8eb9fe4ab1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:28.975583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801013a2-ee6e-488a-9e87-8eb9fe4ab1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:28.975968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801013a2-ee6e-488a-9e87-8eb9fe4ab1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:28.976777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801013a2-ee6e-488a-9e87-8eb9fe4ab1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:28.979726 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801013a2-ee6e-488a-9e87-8eb9fe4ab1f6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:29.011283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 844/1678] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:29.013120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df072a-732c-44c5-80f9-9dea2ce682c0 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:29.031215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df072a-732c-44c5-80f9-9dea2ce682c0 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:29.041159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d75cbe-c482-4574-a3da-ee018b4a87c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:29.042102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d75cbe-c482-4574-a3da-ee018b4a87c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:29.042388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d75cbe-c482-4574-a3da-ee018b4a87c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:29.042683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d75cbe-c482-4574-a3da-ee018b4a87c4 admin admin] PATH_INFO: `/v3/projects/2b5ac6259a5b45cb9e72830e060ad247/users/a9a8f51207b4432e93f8cd7d035b7ead/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:29.090454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d75cbe-c482-4574-a3da-ee018b4a87c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5ac6259a5b45cb9e72830e060ad247, user_id=a9a8f51207b4432e93f8cd7d035b7ead, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:29.093557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d75cbe-c482-4574-a3da-ee018b4a87c4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:29.137517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 835/1679] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:29 2022] PUT /identity/v3/projects/2b5ac6259a5b45cb9e72830e060ad247/users/a9a8f51207b4432e93f8cd7d035b7ead/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:29.149430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266357-5e68-4682-aa0c-11c35dd96997 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:29.149746 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266357-5e68-4682-aa0c-11c35dd96997 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:29.150027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266357-5e68-4682-aa0c-11c35dd96997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:29.216183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c3266357-5e68-4682-aa0c-11c35dd96997 None None] MFA Rules not processed for user `a9a8f51207b4432e93f8cd7d035b7ead`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:29.217638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c3266357-5e68-4682-aa0c-11c35dd96997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:29.394588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 845/1680] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:29.399601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d75cbe-c482-4574-a3da-ee018b4a87c4 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:29.596895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d75cbe-c482-4574-a3da-ee018b4a87c4 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:29.604739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17387ba-9494-4ef3-80cc-ccef747f80e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:29.605928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17387ba-9494-4ef3-80cc-ccef747f80e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:29.606476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17387ba-9494-4ef3-80cc-ccef747f80e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:29.607002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17387ba-9494-4ef3-80cc-ccef747f80e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:29.608696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17387ba-9494-4ef3-80cc-ccef747f80e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:29.629479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17387ba-9494-4ef3-80cc-ccef747f80e5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:29.723157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3266357-5e68-4682-aa0c-11c35dd96997 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:29.724941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c3266357-5e68-4682-aa0c-11c35dd96997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:29.773643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 836/1681] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:29 2022] POST /identity/v3/projects => generated 369 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:38:29.776037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17387ba-9494-4ef3-80cc-ccef747f80e5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:29.819808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3266357-5e68-4682-aa0c-11c35dd96997 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:29.930449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17387ba-9494-4ef3-80cc-ccef747f80e5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:29.956566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b84d5-b844-46d4-92b8-0c10d556919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:29.957436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b84d5-b844-46d4-92b8-0c10d556919d admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:29.957997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b84d5-b844-46d4-92b8-0c10d556919d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:29.958408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b84d5-b844-46d4-92b8-0c10d556919d admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:29.959228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b84d5-b844-46d4-92b8-0c10d556919d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:29.961305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b84d5-b844-46d4-92b8-0c10d556919d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:30.000356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:30.018138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 837/1682] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:29 2022] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:30.022561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b84d5-b844-46d4-92b8-0c10d556919d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:30.039735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.040648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.042322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] PATH_INFO: `/v3/projects/d7eab63757454afcbfd94be11cbc2f75` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.044712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7eab63757454afcbfd94be11cbc2f75)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:30.046984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:30.051572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b84d5-b844-46d4-92b8-0c10d556919d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:30.057232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85b58f-e217-40f0-8790-fd574cc824b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:30.058331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85b58f-e217-40f0-8790-fd574cc824b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.059013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85b58f-e217-40f0-8790-fd574cc824b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.059735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85b58f-e217-40f0-8790-fd574cc824b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.060685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85b58f-e217-40f0-8790-fd574cc824b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:30.068563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85b58f-e217-40f0-8790-fd574cc824b5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:30.096835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 838/1683] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:38:30.104764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85b58f-e217-40f0-8790-fd574cc824b5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:30.125106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85b58f-e217-40f0-8790-fd574cc824b5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:30.138326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980ae11-b349-432a-b157-45ae90b3dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:30.140888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980ae11-b349-432a-b157-45ae90b3dff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.142417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980ae11-b349-432a-b157-45ae90b3dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.144481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980ae11-b349-432a-b157-45ae90b3dff7 admin admin] PATH_INFO: `/v3/projects/79bbe155db5049719a73be13f6015927/users/52b1d85990e54499844354561aa1d086/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.199767 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980ae11-b349-432a-b157-45ae90b3dff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bbe155db5049719a73be13f6015927, user_id=52b1d85990e54499844354561aa1d086, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:30.209169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980ae11-b349-432a-b157-45ae90b3dff7 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:30.238644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7eab63757454afcbfd94be11cbc2f75', 'request_id': 'req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:30.274730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 839/1684] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:30 2022] PUT /identity/v3/projects/79bbe155db5049719a73be13f6015927/users/52b1d85990e54499844354561aa1d086/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:30.278669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980ae11-b349-432a-b157-45ae90b3dff7 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:30.279303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7eab63757454afcbfd94be11cbc2f75', 'request_id': 'req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:30.310080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7eab63757454afcbfd94be11cbc2f75', 'request_id': 'req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:30.337863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] The token cache is being invalidate because project d7eab63757454afcbfd94be11cbc2f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:30.338087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:30.339537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c30fd9c6-a28e-442a-b3fe-28aba6b72dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:30.341454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 846/1685] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:29 2022] DELETE /identity/v3/projects/d7eab63757454afcbfd94be11cbc2f75 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:30.347217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920719d6-1238-48a8-a4c5-e8b930d86813 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.348044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920719d6-1238-48a8-a4c5-e8b930d86813 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.349113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920719d6-1238-48a8-a4c5-e8b930d86813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.416565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-920719d6-1238-48a8-a4c5-e8b930d86813 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:30.418332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-920719d6-1238-48a8-a4c5-e8b930d86813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:30.534539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980ae11-b349-432a-b157-45ae90b3dff7 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:30.555647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:30.556346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.556631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.556905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.557690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:30.560511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:30.588485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 840/1686] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:30.589796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:30.601293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:30.632925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 847/1687] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:30.641077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82374a-55ba-42fe-b6fc-4128623850e5 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.641600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82374a-55ba-42fe-b6fc-4128623850e5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.642012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82374a-55ba-42fe-b6fc-4128623850e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.679037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928f023-dbaf-4f5c-bb59-6591ee827a4f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:30.704689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ac82374a-55ba-42fe-b6fc-4128623850e5 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:30.707222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29beb959-636a-4639-ba54-dde66316bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:30.708153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ac82374a-55ba-42fe-b6fc-4128623850e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:30.708489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beb959-636a-4639-ba54-dde66316bd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.708910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beb959-636a-4639-ba54-dde66316bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.709376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beb959-636a-4639-ba54-dde66316bd66 admin admin] PATH_INFO: `/v3/projects/79bbe155db5049719a73be13f6015927/users/52b1d85990e54499844354561aa1d086/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.720086 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29beb959-636a-4639-ba54-dde66316bd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bbe155db5049719a73be13f6015927, user_id=52b1d85990e54499844354561aa1d086, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:30.723014 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29beb959-636a-4639-ba54-dde66316bd66 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:30.734772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 848/1688] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:30.744638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82374a-55ba-42fe-b6fc-4128623850e5 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:30.782488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 841/1689] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:30 2022] PUT /identity/v3/projects/79bbe155db5049719a73be13f6015927/users/52b1d85990e54499844354561aa1d086/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:30.784750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf30e0-1485-4fa2-a7a6-fefa0ab95b58 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.785148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf30e0-1485-4fa2-a7a6-fefa0ab95b58 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.785554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf30e0-1485-4fa2-a7a6-fefa0ab95b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.787825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82374a-55ba-42fe-b6fc-4128623850e5 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:30.903918 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-12bf30e0-1485-4fa2-a7a6-fefa0ab95b58 None None] MFA Rules not processed for user `52b1d85990e54499844354561aa1d086`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:30.919576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-12bf30e0-1485-4fa2-a7a6-fefa0ab95b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:30.989286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:30.990008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:30.990294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:30.990571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:30.991308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:30.992106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:30.993767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:31.023275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 849/1690] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:31.024499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:31.044527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a1922-129a-4ce1-abbf-d486bd6e706b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:31.057029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cc2d-1c2d-4f3f-8468-a77c31235dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:31.058108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc2d-1c2d-4f3f-8468-a77c31235dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.058787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc2d-1c2d-4f3f-8468-a77c31235dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.059401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cc2d-1c2d-4f3f-8468-a77c31235dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:31.060327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cc2d-1c2d-4f3f-8468-a77c31235dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:31.064739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cc2d-1c2d-4f3f-8468-a77c31235dc4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:31.103594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 842/1691] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:31.116825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf30e0-1485-4fa2-a7a6-fefa0ab95b58 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:31.118884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-12bf30e0-1485-4fa2-a7a6-fefa0ab95b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:31.129804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 850/1692] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:31 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:31.134178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cc2d-1c2d-4f3f-8468-a77c31235dc4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:31.347440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf30e0-1485-4fa2-a7a6-fefa0ab95b58 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:31.361994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cc2d-1c2d-4f3f-8468-a77c31235dc4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:31.381413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b649792-8cf3-4c9a-a513-df56fc08cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:31.382142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649792-8cf3-4c9a-a513-df56fc08cd4c admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.382439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649792-8cf3-4c9a-a513-df56fc08cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.382706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649792-8cf3-4c9a-a513-df56fc08cd4c admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:31.388110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b649792-8cf3-4c9a-a513-df56fc08cd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:31.390135 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b649792-8cf3-4c9a-a513-df56fc08cd4c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:31.464088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 851/1693] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:31 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:31.469051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b649792-8cf3-4c9a-a513-df56fc08cd4c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:31.490426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b649792-8cf3-4c9a-a513-df56fc08cd4c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:31.498045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070afbe-f7b3-41f6-8e2a-e287cfb2582e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:31.498982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070afbe-f7b3-41f6-8e2a-e287cfb2582e service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.499567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070afbe-f7b3-41f6-8e2a-e287cfb2582e service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.499985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070afbe-f7b3-41f6-8e2a-e287cfb2582e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:31.507718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39737-3921-4c39-a38b-3788a7a92cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:31.512148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39737-3921-4c39-a38b-3788a7a92cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.517966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39737-3921-4c39-a38b-3788a7a92cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.518492 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39737-3921-4c39-a38b-3788a7a92cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:31.519813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed39737-3921-4c39-a38b-3788a7a92cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:31.522158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed39737-3921-4c39-a38b-3788a7a92cd1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:31.543940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 852/1694] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:31.546488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39737-3921-4c39-a38b-3788a7a92cd1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:31.574599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39737-3921-4c39-a38b-3788a7a92cd1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:31.581944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d4cb5-fb7e-4d65-b37a-8d20c0396f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:31.582899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d4cb5-fb7e-4d65-b37a-8d20c0396f90 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.583317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d4cb5-fb7e-4d65-b37a-8d20c0396f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.583735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d4cb5-fb7e-4d65-b37a-8d20c0396f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:31.584585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d4cb5-fb7e-4d65-b37a-8d20c0396f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:31.588501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d4cb5-fb7e-4d65-b37a-8d20c0396f90 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:31.619027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 853/1695] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:31.620909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d4cb5-fb7e-4d65-b37a-8d20c0396f90 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:31.648704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d4cb5-fb7e-4d65-b37a-8d20c0396f90 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:31.660557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea94f4-e62c-445f-83be-98569a7a9e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:31.663115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea94f4-e62c-445f-83be-98569a7a9e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.663115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea94f4-e62c-445f-83be-98569a7a9e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.663115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea94f4-e62c-445f-83be-98569a7a9e8e admin admin] PATH_INFO: `/v3/projects/c3c3f97c16924379bbbfde15df0b0227/users/253f0a28aa4d47c98cef8cc4002bca8d/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:31.676269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070afbe-f7b3-41f6-8e2a-e287cfb2582e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:31.683308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070afbe-f7b3-41f6-8e2a-e287cfb2582e service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:31.690023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea94f4-e62c-445f-83be-98569a7a9e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c3f97c16924379bbbfde15df0b0227, user_id=253f0a28aa4d47c98cef8cc4002bca8d, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:31.696259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea94f4-e62c-445f-83be-98569a7a9e8e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:31.713874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 843/1696] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:31.746987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 854/1697] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:31 2022] PUT /identity/v3/projects/c3c3f97c16924379bbbfde15df0b0227/users/253f0a28aa4d47c98cef8cc4002bca8d/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:31.748968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed38b-8b58-4092-b5f6-506c5c29752d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.749334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed38b-8b58-4092-b5f6-506c5c29752d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.749807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed38b-8b58-4092-b5f6-506c5c29752d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:31.815187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-6e6ed38b-8b58-4092-b5f6-506c5c29752d None None] MFA Rules not processed for user `253f0a28aa4d47c98cef8cc4002bca8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:31.816767 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-6e6ed38b-8b58-4092-b5f6-506c5c29752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:31.851351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8c6e1-6e4a-4a57-b678-16c8442bec26 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.851646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8c6e1-6e4a-4a57-b678-16c8442bec26 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.851929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8c6e1-6e4a-4a57-b678-16c8442bec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:31.902507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-82b8c6e1-6e4a-4a57-b678-16c8442bec26 None None] MFA Rules not processed for user `c6bb9dabb1fc46dda1fe1906ab248c57`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:31.903750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-82b8c6e1-6e4a-4a57-b678-16c8442bec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:31.974508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 844/1698] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:31.977939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2da88-96fb-4210-a888-c8c72df9dc0f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:31.978244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2da88-96fb-4210-a888-c8c72df9dc0f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:31.978526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2da88-96fb-4210-a888-c8c72df9dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:32.024594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-73d2da88-96fb-4210-a888-c8c72df9dc0f None None] MFA Rules not processed for user `cb70f7eb7b44487a9ee3f331c83f9e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:32.026335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-73d2da88-96fb-4210-a888-c8c72df9dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:32.029617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 855/1699] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:32.030487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8c6e1-6e4a-4a57-b678-16c8442bec26 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:32.135428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 845/1700] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:32.135750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8c6e1-6e4a-4a57-b678-16c8442bec26 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:32.136368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2da88-96fb-4210-a888-c8c72df9dc0f None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:32.142650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-73d2da88-96fb-4210-a888-c8c72df9dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:32.146380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61ba51-4695-435f-a7b0-d529ea9e647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:32.147218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ba51-4695-435f-a7b0-d529ea9e647c admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:32.147608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ba51-4695-435f-a7b0-d529ea9e647c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:32.148014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ba51-4695-435f-a7b0-d529ea9e647c admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:32.148828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61ba51-4695-435f-a7b0-d529ea9e647c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:32.151415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61ba51-4695-435f-a7b0-d529ea9e647c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:32.200964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 856/1701] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:32 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:32.204353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202bd0a-4e2c-42e5-a88d-72b951cd343f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:32.204795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202bd0a-4e2c-42e5-a88d-72b951cd343f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:32.205222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202bd0a-4e2c-42e5-a88d-72b951cd343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:32.257729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2da88-96fb-4210-a888-c8c72df9dc0f None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:32.270778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8202bd0a-4e2c-42e5-a88d-72b951cd343f None None] MFA Rules not processed for user `cb70f7eb7b44487a9ee3f331c83f9e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:32.272888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8202bd0a-4e2c-42e5-a88d-72b951cd343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:32.344503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 857/1702] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:32.345655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202bd0a-4e2c-42e5-a88d-72b951cd343f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:32.348775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:32.349506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:32.349823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:32.350107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:32.434188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:32.436844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:32.459525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 846/1703] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:32.461250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:32.465122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:32.469183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202bd0a-4e2c-42e5-a88d-72b951cd343f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:32.474835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831414e-dc47-4e8c-8f07-6797d9f001ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:32.475975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831414e-dc47-4e8c-8f07-6797d9f001ba admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:32.476355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831414e-dc47-4e8c-8f07-6797d9f001ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:32.476759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831414e-dc47-4e8c-8f07-6797d9f001ba admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:32.481834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831414e-dc47-4e8c-8f07-6797d9f001ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:32.487812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0e112-52ba-492a-a318-350bad1ff713 service nova] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:32.487936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831414e-dc47-4e8c-8f07-6797d9f001ba admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:32.499452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87640e0-1927-44c2-a64c-734322757cc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:32.500534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87640e0-1927-44c2-a64c-734322757cc2 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:32.501002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87640e0-1927-44c2-a64c-734322757cc2 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:32.501455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87640e0-1927-44c2-a64c-734322757cc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:32.512509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87640e0-1927-44c2-a64c-734322757cc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:32.514706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87640e0-1927-44c2-a64c-734322757cc2 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:32.529980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 858/1704] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:32 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:32.534030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831414e-dc47-4e8c-8f07-6797d9f001ba admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:32.546326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 847/1705] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:32.565098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831414e-dc47-4e8c-8f07-6797d9f001ba admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:32.576480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae4cae-34e1-4849-8f80-13d425b5f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:32.577238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4cae-34e1-4849-8f80-13d425b5f57e admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:32.577529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4cae-34e1-4849-8f80-13d425b5f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:32.577953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae4cae-34e1-4849-8f80-13d425b5f57e admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:32.584856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae4cae-34e1-4849-8f80-13d425b5f57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:32.587591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae4cae-34e1-4849-8f80-13d425b5f57e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:32.612974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 859/1706] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:32.617493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87640e0-1927-44c2-a64c-734322757cc2 service nova] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:32.648467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87640e0-1927-44c2-a64c-734322757cc2 service nova] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:32.685003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27da6e2-19c2-4a72-ad68-77caf817c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:32.686575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27da6e2-19c2-4a72-ad68-77caf817c4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:32.693491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27da6e2-19c2-4a72-ad68-77caf817c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:32.697026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27da6e2-19c2-4a72-ad68-77caf817c4cc admin admin] PATH_INFO: `/v3/projects/05cc325216304c03a521b09afb333bf3/users/7882ec8855d74c8b85173f80b0fdb582/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:32.774101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27da6e2-19c2-4a72-ad68-77caf817c4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cc325216304c03a521b09afb333bf3, user_id=7882ec8855d74c8b85173f80b0fdb582, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:32.791524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27da6e2-19c2-4a72-ad68-77caf817c4cc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:32.826789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 848/1707] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:32 2022] PUT /identity/v3/projects/05cc325216304c03a521b09afb333bf3/users/7882ec8855d74c8b85173f80b0fdb582/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:32.831995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae4cae-34e1-4849-8f80-13d425b5f57e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:32.855784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae4cae-34e1-4849-8f80-13d425b5f57e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:33.058419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfe96e-2372-40a2-b544-f66c4830b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:33.059116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe96e-2372-40a2-b544-f66c4830b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:33.059396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe96e-2372-40a2-b544-f66c4830b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:33.059666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe96e-2372-40a2-b544-f66c4830b8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:33.068524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe96e-2372-40a2-b544-f66c4830b8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:33.075472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe96e-2372-40a2-b544-f66c4830b8e8 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:33.128135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27da6e2-19c2-4a72-ad68-77caf817c4cc admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:33.129144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 860/1708] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:33.146579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27da6e2-19c2-4a72-ad68-77caf817c4cc admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:33.160962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:33.167389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:33.167675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:33.167956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] PATH_INFO: `/v3/projects/05cc325216304c03a521b09afb333bf3/users/7882ec8855d74c8b85173f80b0fdb582/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:33.176862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cc325216304c03a521b09afb333bf3, user_id=7882ec8855d74c8b85173f80b0fdb582, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:33.198877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:33.236470 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 849/1709] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:33 2022] PUT /identity/v3/projects/05cc325216304c03a521b09afb333bf3/users/7882ec8855d74c8b85173f80b0fdb582/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:38:33.248242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d579-144f-46fd-a390-6e10f670ae4e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:33.248750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d579-144f-46fd-a390-6e10f670ae4e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:33.248822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d579-144f-46fd-a390-6e10f670ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:33.355724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c037d579-144f-46fd-a390-6e10f670ae4e None None] MFA Rules not processed for user `7882ec8855d74c8b85173f80b0fdb582`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:33.359444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c037d579-144f-46fd-a390-6e10f670ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:33.574605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 861/1710] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:33.643021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:33.645814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:33.753484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f44d2-bb61-44b4-890b-4a9c23fec6ee admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:33.768616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:33.769297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:33.769618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:33.769908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:33.806466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:33.807937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:33.834983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 850/1711] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:33.899450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037d579-144f-46fd-a390-6e10f670ae4e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:33.997593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:33.999770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:34.099588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037d579-144f-46fd-a390-6e10f670ae4e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:34.106154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:34.107213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:34.108353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:34.108763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] PATH_INFO: `/v3/users/253f0a28aa4d47c98cef8cc4002bca8d` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:34.110214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=253f0a28aa4d47c98cef8cc4002bca8d)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:34.114004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:34.202677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5cc2-6e7a-4b86-bba6-f923a1a2955a service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:34.214193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:34.215084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:34.215368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:34.215649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] PATH_INFO: `/v3/users/f45a14e589ba491f90452d8923620358` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:34.218271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45a14e589ba491f90452d8923620358)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:34.220206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:34.220831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253f0a28aa4d47c98cef8cc4002bca8d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.253106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253f0a28aa4d47c98cef8cc4002bca8d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.269102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253f0a28aa4d47c98cef8cc4002bca8d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.269989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253f0a28aa4d47c98cef8cc4002bca8d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.292688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426a348c-4d06-4f3e-a9e0-62efc24192cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253f0a28aa4d47c98cef8cc4002bca8d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.308382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 862/1712] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:33 2022] DELETE /identity/v3/users/253f0a28aa4d47c98cef8cc4002bca8d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:34.311546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9466d23-795a-4056-bf5e-a507ea7debf0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:34.311997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9466d23-795a-4056-bf5e-a507ea7debf0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:34.314739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9466d23-795a-4056-bf5e-a507ea7debf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:34.356199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45a14e589ba491f90452d8923620358'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.359488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c9466d23-795a-4056-bf5e-a507ea7debf0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:34.362134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c9466d23-795a-4056-bf5e-a507ea7debf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:34.425927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45a14e589ba491f90452d8923620358'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.431874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45a14e589ba491f90452d8923620358'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.455834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45a14e589ba491f90452d8923620358'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.460711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ac985d03-827f-4648-b119-8e0913654816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45a14e589ba491f90452d8923620358'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:34.489202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 851/1713] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:33 2022] DELETE /identity/v3/users/f45a14e589ba491f90452d8923620358 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:34.494494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5016-aef9-4ace-858a-bc6db6b48c00 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:34.495208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5016-aef9-4ace-858a-bc6db6b48c00 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:34.495639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5016-aef9-4ace-858a-bc6db6b48c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:34.552986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8c3b5016-aef9-4ace-858a-bc6db6b48c00 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:34.555007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8c3b5016-aef9-4ace-858a-bc6db6b48c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:34.567718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 863/1714] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:34.698444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9466d23-795a-4056-bf5e-a507ea7debf0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:34.701720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c9466d23-795a-4056-bf5e-a507ea7debf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:34.790091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 852/1715] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:34.830089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa1bc-8f26-45ea-80c5-2390d657fa45 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:34.830895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa1bc-8f26-45ea-80c5-2390d657fa45 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:34.831372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa1bc-8f26-45ea-80c5-2390d657fa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:34.890425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-384fa1bc-8f26-45ea-80c5-2390d657fa45 None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:34.895129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-384fa1bc-8f26-45ea-80c5-2390d657fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:34.959554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9466d23-795a-4056-bf5e-a507ea7debf0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:35.040139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 853/1716] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:38:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:35.042036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e8fe3-9e11-4d08-9ba3-25b3d8350a79 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:35.042577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e8fe3-9e11-4d08-9ba3-25b3d8350a79 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:35.043245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e8fe3-9e11-4d08-9ba3-25b3d8350a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:35.098263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-9f6e8fe3-9e11-4d08-9ba3-25b3d8350a79 None None] MFA Rules not processed for user `cb70f7eb7b44487a9ee3f331c83f9e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:35.114260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9f6e8fe3-9e11-4d08-9ba3-25b3d8350a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:35.170801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:35.175329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:35.175619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:35.175900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:35.196348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:35.199320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:35.234357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 864/1717] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:35.237161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:35.241880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:35.277375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc3743-9c2b-4fe3-b715-76260ea167c1 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:35.296167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:35.308467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:35.308740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 854/1718] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:35.326143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:35.338818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:35.377829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:35.381247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:35.418142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e8fe3-9e11-4d08-9ba3-25b3d8350a79 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:35.419640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9f6e8fe3-9e11-4d08-9ba3-25b3d8350a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:35.434662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 865/1719] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:35.689081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e8fe3-9e11-4d08-9ba3-25b3d8350a79 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:35.692797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:35.694436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:35.722259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099a9e-bf93-4734-a311-e8f83ebf0caf service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:35.730736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:35.731615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:35.733848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:35.737844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:35.737980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:35.738755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:35.739040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:35.739646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] PATH_INFO: `/v3/users/a9a8f51207b4432e93f8cd7d035b7ead` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:35.741054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a8f51207b4432e93f8cd7d035b7ead)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:35.743514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:35.777360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:35.779268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:35.799458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 855/1720] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:38:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 07:38:35.821811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:35.829194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:35.885349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b706925-cd7d-4516-be7f-1c1c7544f478 service swift] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:35.900533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:35.902245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:35.902826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:35.904103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] PATH_INFO: `/v3/users/c23e90a89ee8446593637aba3c106989` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:35.907644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23e90a89ee8446593637aba3c106989)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:35.920984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:35.924039 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a8f51207b4432e93f8cd7d035b7ead'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:35.996315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a8f51207b4432e93f8cd7d035b7ead'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.039518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a8f51207b4432e93f8cd7d035b7ead'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.042929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a8f51207b4432e93f8cd7d035b7ead'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.081498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c446068f-01a2-4745-b391-3e042f1ee5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a8f51207b4432e93f8cd7d035b7ead'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.097246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23e90a89ee8446593637aba3c106989'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.119512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 866/1721] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:35 2022] DELETE /identity/v3/users/a9a8f51207b4432e93f8cd7d035b7ead => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:36.132744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd469a1a-2896-46ef-a311-cc0db48f69b0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:36.140782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd469a1a-2896-46ef-a311-cc0db48f69b0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:36.145974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd469a1a-2896-46ef-a311-cc0db48f69b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:36.168972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23e90a89ee8446593637aba3c106989'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.170132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23e90a89ee8446593637aba3c106989'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.211268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23e90a89ee8446593637aba3c106989'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.222198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723aa152-fc73-4324-a83a-a323dad96241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23e90a89ee8446593637aba3c106989'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:36.232561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-bd469a1a-2896-46ef-a311-cc0db48f69b0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:36.233946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bd469a1a-2896-46ef-a311-cc0db48f69b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:36.267073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 856/1722] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:35 2022] DELETE /identity/v3/users/c23e90a89ee8446593637aba3c106989 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:36.271599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd4a5-5c63-4cce-879a-2aa538e29c32 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:36.273914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd4a5-5c63-4cce-879a-2aa538e29c32 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:36.274421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd4a5-5c63-4cce-879a-2aa538e29c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:36.338729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-dfdfd4a5-5c63-4cce-879a-2aa538e29c32 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:36.340354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-dfdfd4a5-5c63-4cce-879a-2aa538e29c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:36.528614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 857/1723] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:36.541674 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 867/1724] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:36.655858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd4a5-5c63-4cce-879a-2aa538e29c32 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:36.657712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-dfdfd4a5-5c63-4cce-879a-2aa538e29c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:36.663616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd469a1a-2896-46ef-a311-cc0db48f69b0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:36.665414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bd469a1a-2896-46ef-a311-cc0db48f69b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:36.869638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd4a5-5c63-4cce-879a-2aa538e29c32 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:36.897525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:36.901431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:36.906312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:36.908480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:36.926994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd469a1a-2896-46ef-a311-cc0db48f69b0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:36.973423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570dc64-39a1-4d07-b26c-004019552e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:36.988673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570dc64-39a1-4d07-b26c-004019552e0e service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:36.990541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570dc64-39a1-4d07-b26c-004019552e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:36.990747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570dc64-39a1-4d07-b26c-004019552e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:36.991797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:36.993597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:37.061351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 858/1725] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:37.062210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570dc64-39a1-4d07-b26c-004019552e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:37.081127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570dc64-39a1-4d07-b26c-004019552e0e service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:37.127636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 868/1726] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:38:37.253998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:37.255463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:37.286028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74578017-a838-49a6-9e2e-55c1ead36756 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:37.306539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:37.308379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:37.309033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:37.309495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] PATH_INFO: `/v3/users/16b9184129754c5e9eae0761124c9a47` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:37.311423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b9184129754c5e9eae0761124c9a47)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:37.314656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:37.339915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506045c-f56b-4a14-a396-11e7ec2f7dbc None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:37.340678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506045c-f56b-4a14-a396-11e7ec2f7dbc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:37.341296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506045c-f56b-4a14-a396-11e7ec2f7dbc None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:37.344107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 869/1727] 10.222.0.36 () {54 vars in 912 bytes} [Wed May 11 07:38:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:37.351109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fe4f3-17cf-45ed-b5e6-64bc4c4385db None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:37.351648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fe4f3-17cf-45ed-b5e6-64bc4c4385db None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:37.352144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fe4f3-17cf-45ed-b5e6-64bc4c4385db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:37.398048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-467fe4f3-17cf-45ed-b5e6-64bc4c4385db None None] MFA Rules not processed for user `66b60e827f404e3891e4f24ca842e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:37.407625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-467fe4f3-17cf-45ed-b5e6-64bc4c4385db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:37.426438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 870/1728] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:38:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:37.450610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b9184129754c5e9eae0761124c9a47'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:37.474468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b9184129754c5e9eae0761124c9a47'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:37.475951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b9184129754c5e9eae0761124c9a47'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:37.497637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b9184129754c5e9eae0761124c9a47'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:37.499061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01624198-7c87-4f12-bf9a-2ed825bdfef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b9184129754c5e9eae0761124c9a47'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:37.523163 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fe4f3-17cf-45ed-b5e6-64bc4c4385db None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:37.543716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fe4f3-17cf-45ed-b5e6-64bc4c4385db None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:37.544535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 859/1729] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:37 2022] DELETE /identity/v3/users/16b9184129754c5e9eae0761124c9a47 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:37.548516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55690b-7620-4d56-b2ba-86c42b9bb30d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:37.549712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55690b-7620-4d56-b2ba-86c42b9bb30d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:37.551276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55690b-7620-4d56-b2ba-86c42b9bb30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:37.643384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-bf55690b-7620-4d56-b2ba-86c42b9bb30d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:37.648280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-bf55690b-7620-4d56-b2ba-86c42b9bb30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:37.759560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:37.760517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:37.760808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:37.761097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:37.766397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:37.798248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:37.800599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:37.822801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 871/1730] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:37.828286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 860/1731] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:37.978983 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:37.984540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:37.994748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55690b-7620-4d56-b2ba-86c42b9bb30d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:37.996810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-bf55690b-7620-4d56-b2ba-86c42b9bb30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:38.023908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b3040-601b-49d2-bdae-0d748afffa5d service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:38.028462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55690b-7620-4d56-b2ba-86c42b9bb30d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:38.055086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5615-5e23-410e-a819-74d21fb25552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:38.059362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5615-5e23-410e-a819-74d21fb25552 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:38.063357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5615-5e23-410e-a819-74d21fb25552 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:38.078504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5615-5e23-410e-a819-74d21fb25552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:38.085827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:38.087426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:38.090842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:38.093059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] PATH_INFO: `/v3/projects/c3c3f97c16924379bbbfde15df0b0227` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:38.102640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c3f97c16924379bbbfde15df0b0227)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:38.111069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:38.126338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5615-5e23-410e-a819-74d21fb25552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:38.130841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f5615-5e23-410e-a819-74d21fb25552 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:38.161594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 872/1732] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:38.327638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c3f97c16924379bbbfde15df0b0227', 'request_id': 'req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.348380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c3f97c16924379bbbfde15df0b0227', 'request_id': 'req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.368103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c3f97c16924379bbbfde15df0b0227', 'request_id': 'req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.390306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] The token cache is being invalidate because project c3c3f97c16924379bbbfde15df0b0227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:38.390668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.391799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4f88d1da-0315-42b0-bf8a-3b4b2098b9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.400055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 861/1733] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:37 2022] DELETE /identity/v3/projects/c3c3f97c16924379bbbfde15df0b0227 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:38:38.404019 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5615-5e23-410e-a819-74d21fb25552 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:38.416804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f5615-5e23-410e-a819-74d21fb25552 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:38.617068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:38.618019 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:38.618376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:38.618760 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] PATH_INFO: `/v3/users/7882ec8855d74c8b85173f80b0fdb582` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:38.627768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7882ec8855d74c8b85173f80b0fdb582)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:38.642248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:38.743719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7882ec8855d74c8b85173f80b0fdb582'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.778559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7882ec8855d74c8b85173f80b0fdb582'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.791680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7882ec8855d74c8b85173f80b0fdb582'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.796082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7882ec8855d74c8b85173f80b0fdb582'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.819260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7882ec8855d74c8b85173f80b0fdb582'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:38.831637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 873/1734] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:38 2022] DELETE /identity/v3/users/7882ec8855d74c8b85173f80b0fdb582 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:38.940138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cea6e-0cb0-473b-8145-da07fdb19c4e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:38.940525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cea6e-0cb0-473b-8145-da07fdb19c4e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:38.940970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cea6e-0cb0-473b-8145-da07fdb19c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:39.022621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e44cea6e-0cb0-473b-8145-da07fdb19c4e None None] MFA Rules not processed for user `66b60e827f404e3891e4f24ca842e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:39.029103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e44cea6e-0cb0-473b-8145-da07fdb19c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:39.030855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:39.032574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:39.149857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 862/1735] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 11 07:38:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:39.218792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960fd98-60fd-45bb-a3b5-700a253def6b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:39.237573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:39.242300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:39.242948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:39.244920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] PATH_INFO: `/v3/projects/f90f628876264b8bac72381eb338c07e` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:39.251079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90f628876264b8bac72381eb338c07e)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:39.260798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:39.307229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cea6e-0cb0-473b-8145-da07fdb19c4e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:39.309344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e44cea6e-0cb0-473b-8145-da07fdb19c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:39.334827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cea6e-0cb0-473b-8145-da07fdb19c4e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:39.344186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282bb5-35a6-43e9-a430-07efbd96741a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:39.345812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282bb5-35a6-43e9-a430-07efbd96741a service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:39.346491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282bb5-35a6-43e9-a430-07efbd96741a service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:39.347174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282bb5-35a6-43e9-a430-07efbd96741a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:39.367521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282bb5-35a6-43e9-a430-07efbd96741a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:39.371909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282bb5-35a6-43e9-a430-07efbd96741a service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:39.412890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 863/1736] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:39.438586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90f628876264b8bac72381eb338c07e', 'request_id': 'req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:39.451129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90f628876264b8bac72381eb338c07e', 'request_id': 'req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:39.482275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90f628876264b8bac72381eb338c07e', 'request_id': 'req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:39.512695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] The token cache is being invalidate because project f90f628876264b8bac72381eb338c07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:39.512982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:39.518118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c5c1765d-44e2-4a0d-ad00-0e2a007eeb71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:39.523972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 874/1737] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:39 2022] DELETE /identity/v3/projects/f90f628876264b8bac72381eb338c07e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:39.528616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd9dc-eb7b-4133-a6e1-7276c237b738 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:39.528906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd9dc-eb7b-4133-a6e1-7276c237b738 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:39.529776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd9dc-eb7b-4133-a6e1-7276c237b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:39.567964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b41dd9dc-eb7b-4133-a6e1-7276c237b738 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:39.569180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b41dd9dc-eb7b-4133-a6e1-7276c237b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:39.743226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 864/1738] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:39.748967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aef05-6d58-4127-bff2-bd5f5b8626ad None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:39.749761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aef05-6d58-4127-bff2-bd5f5b8626ad None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:39.750027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067aef05-6d58-4127-bff2-bd5f5b8626ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:39.807674 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-067aef05-6d58-4127-bff2-bd5f5b8626ad None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:39.809183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-067aef05-6d58-4127-bff2-bd5f5b8626ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:39.844548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 875/1739] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:39.845913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dd9dc-eb7b-4133-a6e1-7276c237b738 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:39.872396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dd9dc-eb7b-4133-a6e1-7276c237b738 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:39.902174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:39.903159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:39.903482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:39.903821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:39.904772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:39.905127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:39.918125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:39.947066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 865/1740] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:39.951161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aef05-6d58-4127-bff2-bd5f5b8626ad None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:39.961500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067aef05-6d58-4127-bff2-bd5f5b8626ad None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:39.983653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:39.992146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:39.992146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:39.992146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:39.992492 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:40.002497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:40.128828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:40.129320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 876/1741] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:39 2022] POST /identity/v3/projects => generated 357 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:40.142866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c40f9c-66a4-4d3c-b329-e4fb6ac9bda5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:40.381476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892b99-ab4d-42b0-8975-92323f766af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:40.382260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892b99-ab4d-42b0-8975-92323f766af9 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:40.382652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892b99-ab4d-42b0-8975-92323f766af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:40.382946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892b99-ab4d-42b0-8975-92323f766af9 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:40.383762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892b99-ab4d-42b0-8975-92323f766af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:40.385914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892b99-ab4d-42b0-8975-92323f766af9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:40.466582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 866/1742] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:40 2022] POST /identity/v3/users => generated 279 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:38:40.471731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:40.471862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892b99-ab4d-42b0-8975-92323f766af9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:40.474717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:40.504151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892b99-ab4d-42b0-8975-92323f766af9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:40.505168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9166-163d-41b9-a90d-54aa4c5b7675 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:40.511450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b15b0-4e07-4af2-b537-4d1bfb677b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:40.512193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b15b0-4e07-4af2-b537-4d1bfb677b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:40.512475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b15b0-4e07-4af2-b537-4d1bfb677b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:40.512973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b15b0-4e07-4af2-b537-4d1bfb677b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:40.521026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b15b0-4e07-4af2-b537-4d1bfb677b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:40.523510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b15b0-4e07-4af2-b537-4d1bfb677b58 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:40.531945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:40.533419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:40.533882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:40.534309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] PATH_INFO: `/v3/projects/2b5ac6259a5b45cb9e72830e060ad247` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:40.538027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5ac6259a5b45cb9e72830e060ad247)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:40.541623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:40.575477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 867/1743] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:38:40.579187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b15b0-4e07-4af2-b537-4d1bfb677b58 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:40.628296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b15b0-4e07-4af2-b537-4d1bfb677b58 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:40.639871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab457c-3b1c-47c9-9e3b-c22b3acafb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:40.640762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab457c-3b1c-47c9-9e3b-c22b3acafb11 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:40.651457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab457c-3b1c-47c9-9e3b-c22b3acafb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:40.652079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab457c-3b1c-47c9-9e3b-c22b3acafb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:40.653025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab457c-3b1c-47c9-9e3b-c22b3acafb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:40.661477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab457c-3b1c-47c9-9e3b-c22b3acafb11 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:40.687407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 868/1744] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:40.692290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab457c-3b1c-47c9-9e3b-c22b3acafb11 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:40.729037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5ac6259a5b45cb9e72830e060ad247', 'request_id': 'req-2e56eebf-5236-4ed4-98a0-1c32a2500969'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:40.734729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab457c-3b1c-47c9-9e3b-c22b3acafb11 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:40.767908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5ac6259a5b45cb9e72830e060ad247', 'request_id': 'req-2e56eebf-5236-4ed4-98a0-1c32a2500969'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:40.785212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5ac6259a5b45cb9e72830e060ad247', 'request_id': 'req-2e56eebf-5236-4ed4-98a0-1c32a2500969'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:40.856065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] The token cache is being invalidate because project 2b5ac6259a5b45cb9e72830e060ad247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:40.856362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:40.857054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:40.872841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 877/1745] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:40 2022] DELETE /identity/v3/projects/2b5ac6259a5b45cb9e72830e060ad247 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:40.874999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:40.878924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:40.921481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:40.924261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:40.924561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:40.924844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] PATH_INFO: `/v3/projects/bfe0e8084113485fa0be9b19673db1ad/users/693d800bf04a4949b9d38de8f80bfd38/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:40.963004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe0e8084113485fa0be9b19673db1ad, user_id=693d800bf04a4949b9d38de8f80bfd38, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:40.967906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:41.002173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 869/1746] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:40 2022] PUT /identity/v3/projects/bfe0e8084113485fa0be9b19673db1ad/users/693d800bf04a4949b9d38de8f80bfd38/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:41.004069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:41.020367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:41.055421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56eebf-5236-4ed4-98a0-1c32a2500969 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:41.198639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44f871-05a0-41d5-9998-c4adc34920e7 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:41.207265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:41.209499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:41.210558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:41.211394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:41.212107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] PATH_INFO: `/v3/users/52b1d85990e54499844354561aa1d086` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:41.212688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:41.213633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:41.214469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] PATH_INFO: `/v3/projects/1f8cf9d79fdd4e3a8b46fb3022a12a9f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:41.217090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b1d85990e54499844354561aa1d086)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:41.224275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8cf9d79fdd4e3a8b46fb3022a12a9f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:41.224275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:41.224709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:41.345556 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8cf9d79fdd4e3a8b46fb3022a12a9f', 'request_id': 'req-4966d43a-6f94-45e7-9002-bac7f70beecd'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.350464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b1d85990e54499844354561aa1d086'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.368308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8cf9d79fdd4e3a8b46fb3022a12a9f', 'request_id': 'req-4966d43a-6f94-45e7-9002-bac7f70beecd'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.381312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b1d85990e54499844354561aa1d086'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.388115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8cf9d79fdd4e3a8b46fb3022a12a9f', 'request_id': 'req-4966d43a-6f94-45e7-9002-bac7f70beecd'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.407218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b1d85990e54499844354561aa1d086'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.409226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b1d85990e54499844354561aa1d086'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.422108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] The token cache is being invalidate because project 1f8cf9d79fdd4e3a8b46fb3022a12a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:41.422717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.424854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4966d43a-6f94-45e7-9002-bac7f70beecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.428674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 870/1747] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:41 2022] DELETE /identity/v3/projects/1f8cf9d79fdd4e3a8b46fb3022a12a9f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:41.430291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea3ff-f270-455d-89ed-e0d512267573 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:41.431836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-17e31266-9f0f-486c-b39b-706acb88bee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b1d85990e54499844354561aa1d086'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:41.432992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea3ff-f270-455d-89ed-e0d512267573 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:41.433279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ea3ff-f270-455d-89ed-e0d512267573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:41.448989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 878/1748] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:40 2022] DELETE /identity/v3/users/52b1d85990e54499844354561aa1d086 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:38:41.450813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c6249-16ca-49ca-bf12-3ecad11b0223 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:41.451224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c6249-16ca-49ca-bf12-3ecad11b0223 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:41.452038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c6249-16ca-49ca-bf12-3ecad11b0223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:41.487587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1f2ea3ff-f270-455d-89ed-e0d512267573 None None] MFA Rules not processed for user `c6bb9dabb1fc46dda1fe1906ab248c57`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:41.491137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1f2ea3ff-f270-455d-89ed-e0d512267573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:41.528418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-7c2c6249-16ca-49ca-bf12-3ecad11b0223 None None] MFA Rules not processed for user `693d800bf04a4949b9d38de8f80bfd38`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:41.532723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7c2c6249-16ca-49ca-bf12-3ecad11b0223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:41.660053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 871/1749] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:41.662197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ea3ff-f270-455d-89ed-e0d512267573 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:41.676268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1f2ea3ff-f270-455d-89ed-e0d512267573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:41.787497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 879/1750] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:41 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:41.790041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6ef9-e5ee-4e25-9b29-fd685bbfc3c6 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:41.790343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6ef9-e5ee-4e25-9b29-fd685bbfc3c6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:41.800072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d6ef9-e5ee-4e25-9b29-fd685bbfc3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:41.882620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ed0d6ef9-e5ee-4e25-9b29-fd685bbfc3c6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:41.885520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ed0d6ef9-e5ee-4e25-9b29-fd685bbfc3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:41.960533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ea3ff-f270-455d-89ed-e0d512267573 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:41.972636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:41.973525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:41.973833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:41.974093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] PATH_INFO: `/v3/projects/05cc325216304c03a521b09afb333bf3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:41.978326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05cc325216304c03a521b09afb333bf3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:41.980341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:42.036185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 880/1751] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:42.037079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6ef9-e5ee-4e25-9b29-fd685bbfc3c6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:42.046956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ed0d6ef9-e5ee-4e25-9b29-fd685bbfc3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:42.081984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d6ef9-e5ee-4e25-9b29-fd685bbfc3c6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:42.131796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05cc325216304c03a521b09afb333bf3', 'request_id': 'req-01d1601a-40f7-4d75-afc5-20eb97b80200'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.141042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05cc325216304c03a521b09afb333bf3', 'request_id': 'req-01d1601a-40f7-4d75-afc5-20eb97b80200'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.154664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05cc325216304c03a521b09afb333bf3', 'request_id': 'req-01d1601a-40f7-4d75-afc5-20eb97b80200'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.180052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] The token cache is being invalidate because project 05cc325216304c03a521b09afb333bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:42.181038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.182823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.187580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 872/1752] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:41 2022] DELETE /identity/v3/projects/05cc325216304c03a521b09afb333bf3 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:42.189570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:42.196592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:42.213583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:42.214330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:42.214624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:42.214891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] PATH_INFO: `/v3/projects/8fd00b81b3b847a19533a7566fda02f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:42.218400 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd00b81b3b847a19533a7566fda02f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:42.224695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:42.327679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd00b81b3b847a19533a7566fda02f6', 'request_id': 'req-bd32196b-4df0-4cba-8e32-614d76f4daea'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.353630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd00b81b3b847a19533a7566fda02f6', 'request_id': 'req-bd32196b-4df0-4cba-8e32-614d76f4daea'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.369845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd00b81b3b847a19533a7566fda02f6', 'request_id': 'req-bd32196b-4df0-4cba-8e32-614d76f4daea'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.396763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] The token cache is being invalidate because project 8fd00b81b3b847a19533a7566fda02f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:42.397064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.401476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd32196b-4df0-4cba-8e32-614d76f4daea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.405347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 881/1753] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:42 2022] DELETE /identity/v3/projects/8fd00b81b3b847a19533a7566fda02f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:42.406970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263bf1-bc44-4a3f-89d2-98cc8650c45b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:42.407260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263bf1-bc44-4a3f-89d2-98cc8650c45b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:42.407539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15263bf1-bc44-4a3f-89d2-98cc8650c45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:42.425225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1601a-40f7-4d75-afc5-20eb97b80200 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:42.486433 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-15263bf1-bc44-4a3f-89d2-98cc8650c45b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:42.487409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-15263bf1-bc44-4a3f-89d2-98cc8650c45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:42.582778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fc285-fb6e-4965-a64c-8e2df558a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:42.583512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc285-fb6e-4965-a64c-8e2df558a515 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:42.583840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc285-fb6e-4965-a64c-8e2df558a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:42.584153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc285-fb6e-4965-a64c-8e2df558a515 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:42.584857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fc285-fb6e-4965-a64c-8e2df558a515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:42.587037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fc285-fb6e-4965-a64c-8e2df558a515 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:42.651638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 873/1754] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:42 2022] POST /identity/v3/projects => generated 355 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:42.655351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8381-30c8-4ac5-b0de-652b8f9cb21e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:42.655654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8381-30c8-4ac5-b0de-652b8f9cb21e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:42.655895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d8381-30c8-4ac5-b0de-652b8f9cb21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:42.661090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 882/1755] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:42.665191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263bf1-bc44-4a3f-89d2-98cc8650c45b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:42.668063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-15263bf1-bc44-4a3f-89d2-98cc8650c45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:42.695112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-182d8381-30c8-4ac5-b0de-652b8f9cb21e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:42.696403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-182d8381-30c8-4ac5-b0de-652b8f9cb21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:42.696819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15263bf1-bc44-4a3f-89d2-98cc8650c45b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:42.834155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:42.835861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:42.836292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:42.836713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] PATH_INFO: `/v3/users/bfdedd85a44445b8914fa73de104c5a1` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:42.838232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfdedd85a44445b8914fa73de104c5a1)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:42.840729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:42.849772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 874/1756] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:42.856378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8381-30c8-4ac5-b0de-652b8f9cb21e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:42.863281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-182d8381-30c8-4ac5-b0de-652b8f9cb21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:42.902977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d8381-30c8-4ac5-b0de-652b8f9cb21e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:42.925872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf2a5f-c784-4b28-a1ea-f866240550b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:42.926585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf2a5f-c784-4b28-a1ea-f866240550b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:42.929223 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf2a5f-c784-4b28-a1ea-f866240550b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:42.929405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf2a5f-c784-4b28-a1ea-f866240550b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:42.933623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf2a5f-c784-4b28-a1ea-f866240550b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:42.941572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfdedd85a44445b8914fa73de104c5a1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.942356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf2a5f-c784-4b28-a1ea-f866240550b6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:42.981427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfdedd85a44445b8914fa73de104c5a1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.994245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfdedd85a44445b8914fa73de104c5a1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:42.995010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfdedd85a44445b8914fa73de104c5a1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:43.008879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 875/1757] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:42 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:43.010159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf2a5f-c784-4b28-a1ea-f866240550b6 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.019442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1ac55b37-544a-4d8f-9a0b-82171aa5c544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfdedd85a44445b8914fa73de104c5a1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:43.032595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 883/1758] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:42 2022] DELETE /identity/v3/users/bfdedd85a44445b8914fa73de104c5a1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:43.035843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffcd64-1a8a-484b-9e9a-fb102b5ef76d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.035843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffcd64-1a8a-484b-9e9a-fb102b5ef76d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.035843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffcd64-1a8a-484b-9e9a-fb102b5ef76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.043204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf2a5f-c784-4b28-a1ea-f866240550b6 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.096982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f4ffcd64-1a8a-484b-9e9a-fb102b5ef76d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:43.109119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f4ffcd64-1a8a-484b-9e9a-fb102b5ef76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:43.199434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.200134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.200418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.200704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.201526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:43.202021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.203583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.231608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 876/1759] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:43.231608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.235150 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:43.257481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 884/1760] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:43.259219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b2ecf-b920-4243-a70b-1554cfb52101 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.259658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b2ecf-b920-4243-a70b-1554cfb52101 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.260715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b2ecf-b920-4243-a70b-1554cfb52101 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.262277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 885/1761] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:43.263005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58dcac-978e-49b1-87c0-438db35f129e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.265111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b2ecf-b920-4243-a70b-1554cfb52101 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.271217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ed1b2ecf-b920-4243-a70b-1554cfb52101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:43.277520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9534-f777-47ba-b4bd-17e3a49d51a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.278263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9534-f777-47ba-b4bd-17e3a49d51a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.278567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9534-f777-47ba-b4bd-17e3a49d51a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.278866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9534-f777-47ba-b4bd-17e3a49d51a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.280318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da9534-f777-47ba-b4bd-17e3a49d51a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.282004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da9534-f777-47ba-b4bd-17e3a49d51a6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.313056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 877/1762] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:43.315686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9534-f777-47ba-b4bd-17e3a49d51a6 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.340105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9534-f777-47ba-b4bd-17e3a49d51a6 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.346470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b2ecf-b920-4243-a70b-1554cfb52101 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.352815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.355970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.359390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.359690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.360930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88304c55-33c0-4775-ae4e-a000fb7c0779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.362465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:43.362831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.363336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88304c55-33c0-4775-ae4e-a000fb7c0779 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.363631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88304c55-33c0-4775-ae4e-a000fb7c0779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.363910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88304c55-33c0-4775-ae4e-a000fb7c0779 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.364628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88304c55-33c0-4775-ae4e-a000fb7c0779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.366620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88304c55-33c0-4775-ae4e-a000fb7c0779 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.368826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.396269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 878/1763] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:43.397167 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.414294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 886/1764] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:43 2022] POST /identity/v3/projects => generated 403 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:43.417358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88304c55-33c0-4775-ae4e-a000fb7c0779 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.418327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154b861-23dd-4d48-9f88-9b99533f6a19 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.510971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88304c55-33c0-4775-ae4e-a000fb7c0779 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.518940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a104c-b350-4838-b229-724205ddb713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.521832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a104c-b350-4838-b229-724205ddb713 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.522528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a104c-b350-4838-b229-724205ddb713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.523236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a104c-b350-4838-b229-724205ddb713 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.524163 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a104c-b350-4838-b229-724205ddb713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.532158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a104c-b350-4838-b229-724205ddb713 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.574886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 887/1765] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:43 2022] POST /identity/v3/projects => generated 409 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:43.575941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a104c-b350-4838-b229-724205ddb713 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.582030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46795a94-a277-411a-8a93-cdcbe1d2d643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.582953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46795a94-a277-411a-8a93-cdcbe1d2d643 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.583247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46795a94-a277-411a-8a93-cdcbe1d2d643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.587510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46795a94-a277-411a-8a93-cdcbe1d2d643 admin admin] PATH_INFO: `/v3/projects/446566eb20f4416d80d78267fd4b7dd8/users/48b027b738e947f1a2c79c11d751fc60/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.641825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46795a94-a277-411a-8a93-cdcbe1d2d643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446566eb20f4416d80d78267fd4b7dd8, user_id=48b027b738e947f1a2c79c11d751fc60, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.644413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46795a94-a277-411a-8a93-cdcbe1d2d643 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.654994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a104c-b350-4838-b229-724205ddb713 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.662451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30b8c1-e2ce-4097-bd03-23b1d66bfcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.665519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30b8c1-e2ce-4097-bd03-23b1d66bfcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.667075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30b8c1-e2ce-4097-bd03-23b1d66bfcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.669572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30b8c1-e2ce-4097-bd03-23b1d66bfcd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.671583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30b8c1-e2ce-4097-bd03-23b1d66bfcd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.677651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30b8c1-e2ce-4097-bd03-23b1d66bfcd1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.677909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 879/1766] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:43 2022] PUT /identity/v3/projects/446566eb20f4416d80d78267fd4b7dd8/users/48b027b738e947f1a2c79c11d751fc60/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:43.680819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a5ad-50a0-41a4-af78-d75ed843ef97 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.681934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a5ad-50a0-41a4-af78-d75ed843ef97 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.683210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a5ad-50a0-41a4-af78-d75ed843ef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.718110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ba03a5ad-50a0-41a4-af78-d75ed843ef97 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:43.719591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ba03a5ad-50a0-41a4-af78-d75ed843ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:43.727299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 888/1767] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:43 2022] POST /identity/v3/users => generated 302 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:43.728880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30b8c1-e2ce-4097-bd03-23b1d66bfcd1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.743598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30b8c1-e2ce-4097-bd03-23b1d66bfcd1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.841418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b8cf9-c61a-4abc-9983-2bda8095d1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.842808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8cf9-c61a-4abc-9983-2bda8095d1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.843403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8cf9-c61a-4abc-9983-2bda8095d1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.843686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b8cf9-c61a-4abc-9983-2bda8095d1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.845381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b8cf9-c61a-4abc-9983-2bda8095d1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.848497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b8cf9-c61a-4abc-9983-2bda8095d1f0 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.852656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 880/1768] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:38:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:43.853728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a5ad-50a0-41a4-af78-d75ed843ef97 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.866674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a5ad-50a0-41a4-af78-d75ed843ef97 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.874039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c45f0-4ab5-4926-9bae-f2239bbe98e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.874941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c45f0-4ab5-4926-9bae-f2239bbe98e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.875444 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c45f0-4ab5-4926-9bae-f2239bbe98e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.875862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c45f0-4ab5-4926-9bae-f2239bbe98e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.876823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c45f0-4ab5-4926-9bae-f2239bbe98e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.878625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c45f0-4ab5-4926-9bae-f2239bbe98e0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.882409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 889/1769] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:43 2022] POST /identity/v3/users => generated 305 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:43.883706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b8cf9-c61a-4abc-9983-2bda8095d1f0 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.894975 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 881/1770] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:43.894975 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c45f0-4ab5-4926-9bae-f2239bbe98e0 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.898611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b8cf9-c61a-4abc-9983-2bda8095d1f0 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.920681 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e4e29-8043-4759-9eb9-29a6c24fca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.921496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4e29-8043-4759-9eb9-29a6c24fca61 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.921888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4e29-8043-4759-9eb9-29a6c24fca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.922236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4e29-8043-4759-9eb9-29a6c24fca61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.923160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e4e29-8043-4759-9eb9-29a6c24fca61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.925055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e4e29-8043-4759-9eb9-29a6c24fca61 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.925187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c45f0-4ab5-4926-9bae-f2239bbe98e0 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.931349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cccb09-eb25-444c-8ade-a364265df79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.932078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cccb09-eb25-444c-8ade-a364265df79f admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.932387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cccb09-eb25-444c-8ade-a364265df79f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.932650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cccb09-eb25-444c-8ade-a364265df79f admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.934159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cccb09-eb25-444c-8ade-a364265df79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.938539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cccb09-eb25-444c-8ade-a364265df79f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:43.946174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 890/1771] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:43.947533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e4e29-8043-4759-9eb9-29a6c24fca61 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.960308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e4e29-8043-4759-9eb9-29a6c24fca61 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.967688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 882/1772] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:43.967688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cccb09-eb25-444c-8ade-a364265df79f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:43.979014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b885-cabd-405b-8024-33aadca5ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.981175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cccb09-eb25-444c-8ade-a364265df79f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:43.981923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b885-cabd-405b-8024-33aadca5ddd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.982274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b885-cabd-405b-8024-33aadca5ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.982564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b885-cabd-405b-8024-33aadca5ddd1 admin admin] PATH_INFO: `/v3/projects/446566eb20f4416d80d78267fd4b7dd8/users/48b027b738e947f1a2c79c11d751fc60/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.984653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96b885-cabd-405b-8024-33aadca5ddd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446566eb20f4416d80d78267fd4b7dd8, user_id=48b027b738e947f1a2c79c11d751fc60, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.988950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685cf88-3513-4cc8-9b05-5d81c3d2535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:43.989836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685cf88-3513-4cc8-9b05-5d81c3d2535b admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:43.991383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685cf88-3513-4cc8-9b05-5d81c3d2535b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:43.992564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685cf88-3513-4cc8-9b05-5d81c3d2535b admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:43.996834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685cf88-3513-4cc8-9b05-5d81c3d2535b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:43.999927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685cf88-3513-4cc8-9b05-5d81c3d2535b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:44.003286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96b885-cabd-405b-8024-33aadca5ddd1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:44.031504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 883/1773] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:44.033705 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685cf88-3513-4cc8-9b05-5d81c3d2535b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:44.036050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 891/1774] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:43 2022] PUT /identity/v3/projects/446566eb20f4416d80d78267fd4b7dd8/users/48b027b738e947f1a2c79c11d751fc60/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:44.042346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b885-cabd-405b-8024-33aadca5ddd1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:44.080910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685cf88-3513-4cc8-9b05-5d81c3d2535b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:44.258371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac5fb-7651-4925-a141-952b3480c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:44.259548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac5fb-7651-4925-a141-952b3480c738 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:44.260001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac5fb-7651-4925-a141-952b3480c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:44.260782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac5fb-7651-4925-a141-952b3480c738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:44.262561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac5fb-7651-4925-a141-952b3480c738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:44.266692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b885-cabd-405b-8024-33aadca5ddd1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:44.274335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac5fb-7651-4925-a141-952b3480c738 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:44.275480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:44.276557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:44.276855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:44.278464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] PATH_INFO: `/v3/projects/bf9c71e905dc4720999680442312b458/users/9707d1901c1c4d0cb31d00305bf8c936/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:44.307527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 884/1775] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:44.313830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829abe0-acee-48a7-8ab6-cb1fea62184e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:44.314148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829abe0-acee-48a7-8ab6-cb1fea62184e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:44.314432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829abe0-acee-48a7-8ab6-cb1fea62184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:44.321515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9c71e905dc4720999680442312b458, user_id=9707d1901c1c4d0cb31d00305bf8c936, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:44.331638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:44.378250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 892/1776] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:44 2022] PUT /identity/v3/projects/bf9c71e905dc4720999680442312b458/users/9707d1901c1c4d0cb31d00305bf8c936/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:44.378250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:44.378250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:44.395237 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8829abe0-acee-48a7-8ab6-cb1fea62184e None None] MFA Rules not processed for user `48b027b738e947f1a2c79c11d751fc60`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:44.396585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8829abe0-acee-48a7-8ab6-cb1fea62184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:44.586987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 885/1777] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:44 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:44.588840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d53fb-a860-451f-aa24-48c4b2ef2b30 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:44.590684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829abe0-acee-48a7-8ab6-cb1fea62184e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:44.607913 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd23f-3584-4c79-8f9f-f910c9e88e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:44.608688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd23f-3584-4c79-8f9f-f910c9e88e8b service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:44.609045 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd23f-3584-4c79-8f9f-f910c9e88e8b service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:44.609394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd23f-3584-4c79-8f9f-f910c9e88e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:44.634977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fd23f-3584-4c79-8f9f-f910c9e88e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:44.636722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fd23f-3584-4c79-8f9f-f910c9e88e8b service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:44.659930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 893/1778] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:44.670343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555c3b-eb54-447f-9499-59ebf73b8bb0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:44.678266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555c3b-eb54-447f-9499-59ebf73b8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:44.678800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555c3b-eb54-447f-9499-59ebf73b8bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:44.741359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ca555c3b-eb54-447f-9499-59ebf73b8bb0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:44.742732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ca555c3b-eb54-447f-9499-59ebf73b8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:44.781147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829abe0-acee-48a7-8ab6-cb1fea62184e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:44.797371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:44.798762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:44.802050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:44.802574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] PATH_INFO: `/v3/projects/70dc2c13c9134d1b9f3567701b8be129/users/7318e8deb8f64464b8ffa3217112acea/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:44.845933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70dc2c13c9134d1b9f3567701b8be129, user_id=7318e8deb8f64464b8ffa3217112acea, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:44.850399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:44.875845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 886/1780] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:44 2022] PUT /identity/v3/projects/70dc2c13c9134d1b9f3567701b8be129/users/7318e8deb8f64464b8ffa3217112acea/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:44.876152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 894/1780] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:44.885487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:44.886362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54655f-f53b-47ea-a827-588e351c4b91 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:44.886472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54655f-f53b-47ea-a827-588e351c4b91 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:44.886833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54655f-f53b-47ea-a827-588e351c4b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:44.887696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:44.947951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-be54655f-f53b-47ea-a827-588e351c4b91 None None] MFA Rules not processed for user `7318e8deb8f64464b8ffa3217112acea`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:44.950651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-be54655f-f53b-47ea-a827-588e351c4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:45.036062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51183d-c1a3-41bb-a5d6-46df30e6dcd4 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:45.048221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:45.049494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:45.049969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:45.050805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:45.163785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 895/1781] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:45.165086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54655f-f53b-47ea-a827-588e351c4b91 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:45.173206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-be54655f-f53b-47ea-a827-588e351c4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:45.230823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:45.232364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:45.267260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 887/1782] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:44 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:45.268249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:45.269954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:45.322821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54655f-f53b-47ea-a827-588e351c4b91 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:45.339898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9460a52-10aa-4648-bb28-b93b0bebbab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:45.340533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460a52-10aa-4648-bb28-b93b0bebbab6 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:45.346277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460a52-10aa-4648-bb28-b93b0bebbab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:45.346277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460a52-10aa-4648-bb28-b93b0bebbab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:45.579917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9460a52-10aa-4648-bb28-b93b0bebbab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:45.586677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9460a52-10aa-4648-bb28-b93b0bebbab6 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:45.616166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 896/1783] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:45.617702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9460a52-10aa-4648-bb28-b93b0bebbab6 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:45.651994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9460a52-10aa-4648-bb28-b93b0bebbab6 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:45.666420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:45.667783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:45.673299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:45.673604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:45.675135 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:45.677813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:45.768471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 897/1784] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:45 2022] POST /identity/v3/projects => generated 409 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:45.769421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:45.778379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:45.923518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44316cb-de14-4c5b-96bd-749ed5c0ba7e service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:45.982856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05fc49-23ce-415c-b47a-4a8d040e9cc5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:46.002688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:46.003832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.004263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.005064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] PATH_INFO: `/v3/projects/79bbe155db5049719a73be13f6015927` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.012335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79bbe155db5049719a73be13f6015927)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:46.017708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:46.068536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:46.069455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.069766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.070094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] PATH_INFO: `/v3/projects/c2964d09955a428388d42f48beef4062` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.071453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2964d09955a428388d42f48beef4062)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:46.076757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:46.225518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79bbe155db5049719a73be13f6015927', 'request_id': 'req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.257981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79bbe155db5049719a73be13f6015927', 'request_id': 'req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.269108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2964d09955a428388d42f48beef4062', 'request_id': 'req-6c955698-9bfa-46fd-866b-d5e64038c156'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.278283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79bbe155db5049719a73be13f6015927', 'request_id': 'req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.287045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2964d09955a428388d42f48beef4062', 'request_id': 'req-6c955698-9bfa-46fd-866b-d5e64038c156'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.292518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] The token cache is being invalidate because project 79bbe155db5049719a73be13f6015927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:46.292992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.293812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.307955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 898/1785] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:45 2022] DELETE /identity/v3/projects/79bbe155db5049719a73be13f6015927 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:46.309340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2964d09955a428388d42f48beef4062', 'request_id': 'req-6c955698-9bfa-46fd-866b-d5e64038c156'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.309562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:46.311840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:46.346658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] The token cache is being invalidate because project c2964d09955a428388d42f48beef4062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:46.346954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.348830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:46.353324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 888/1786] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:45 2022] DELETE /identity/v3/projects/c2964d09955a428388d42f48beef4062 => generated 0 bytes in 1085 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:46.360585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:46.365088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:46.440237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cc69d-3c62-42dd-bd8e-44ac99e5b391 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:46.514656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c955698-9bfa-46fd-866b-d5e64038c156 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:46.521285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043808-d8c7-4732-a803-e62f475dfdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:46.522801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043808-d8c7-4732-a803-e62f475dfdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.523264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043808-d8c7-4732-a803-e62f475dfdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.523840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043808-d8c7-4732-a803-e62f475dfdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.524678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22043808-d8c7-4732-a803-e62f475dfdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:46.527950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22043808-d8c7-4732-a803-e62f475dfdb2 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:46.536332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab001f1-a317-44c5-aa4a-657375113580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:46.537313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab001f1-a317-44c5-aa4a-657375113580 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.537866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab001f1-a317-44c5-aa4a-657375113580 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.538290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab001f1-a317-44c5-aa4a-657375113580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.541705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4ab001f1-a317-44c5-aa4a-657375113580 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:46.581885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 889/1787] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:46 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:46.584660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69dc03-fea7-45db-96e2-3f53d07570e7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.586138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69dc03-fea7-45db-96e2-3f53d07570e7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.586562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69dc03-fea7-45db-96e2-3f53d07570e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.640682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1c69dc03-fea7-45db-96e2-3f53d07570e7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:46.642092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1c69dc03-fea7-45db-96e2-3f53d07570e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:46.651264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 890/1788] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:46.652626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d44b6-10c8-4949-b75f-2a2328b779f8 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.652914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d44b6-10c8-4949-b75f-2a2328b779f8 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.653194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d44b6-10c8-4949-b75f-2a2328b779f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.678596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-576d44b6-10c8-4949-b75f-2a2328b779f8 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:46.680377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-576d44b6-10c8-4949-b75f-2a2328b779f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:46.690210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 891/1789] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:46.691535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d44b6-10c8-4949-b75f-2a2328b779f8 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:46.705855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d44b6-10c8-4949-b75f-2a2328b779f8 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:46.742578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a4b6b-9d32-4b83-b0c0-187cd618a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:46.742724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a4b6b-9d32-4b83-b0c0-187cd618a7ae admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.746465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a4b6b-9d32-4b83-b0c0-187cd618a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.746933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a4b6b-9d32-4b83-b0c0-187cd618a7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.749210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a4b6b-9d32-4b83-b0c0-187cd618a7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:46.765133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a4b6b-9d32-4b83-b0c0-187cd618a7ae admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:46.818574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab001f1-a317-44c5-aa4a-657375113580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:46.828877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab001f1-a317-44c5-aa4a-657375113580 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:46.830162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 892/1790] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:46.831780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2159d7-b300-43a9-8b37-5776b57c8536 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.832079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2159d7-b300-43a9-8b37-5776b57c8536 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.832403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2159d7-b300-43a9-8b37-5776b57c8536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.868431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 899/1791] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:46 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:46.869530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf0e22-9d78-44a6-92ed-152da1ec9e0c None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:46.869859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf0e22-9d78-44a6-92ed-152da1ec9e0c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:46.870141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf0e22-9d78-44a6-92ed-152da1ec9e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:46.905674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1d2159d7-b300-43a9-8b37-5776b57c8536 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:46.906908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1d2159d7-b300-43a9-8b37-5776b57c8536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:46.958658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 893/1792] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:46.959131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d1cf0e22-9d78-44a6-92ed-152da1ec9e0c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:46.961205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2159d7-b300-43a9-8b37-5776b57c8536 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:46.970323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d1cf0e22-9d78-44a6-92ed-152da1ec9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:46.999712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 900/1793] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:47.005659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2159d7-b300-43a9-8b37-5776b57c8536 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.015270 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf0e22-9d78-44a6-92ed-152da1ec9e0c None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:47.027322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d561ff-44c3-4ce7-8753-afaec5809815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.028317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d561ff-44c3-4ce7-8753-afaec5809815 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.028835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d561ff-44c3-4ce7-8753-afaec5809815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.029027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d561ff-44c3-4ce7-8753-afaec5809815 admin admin] PATH_INFO: `/v3/projects/a19ec05974e342e88ecf333714bc5389/users/c59a08b11301416cbc04dffc46f4b4dd/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.047057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf0e22-9d78-44a6-92ed-152da1ec9e0c None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.064690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.066615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.067675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d561ff-44c3-4ce7-8753-afaec5809815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19ec05974e342e88ecf333714bc5389, user_id=c59a08b11301416cbc04dffc46f4b4dd, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:47.068578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.070682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d561ff-44c3-4ce7-8753-afaec5809815 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:47.075829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.078460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:47.080376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:47.084783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:47.137653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 894/1794] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:46 2022] PUT /identity/v3/projects/a19ec05974e342e88ecf333714bc5389/users/c59a08b11301416cbc04dffc46f4b4dd/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:47.139037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d561ff-44c3-4ce7-8753-afaec5809815 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:47.160570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 901/1795] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:47.175884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:47.240513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f60bd-8922-4e70-bf99-9e83a33e6497 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.406918 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d561ff-44c3-4ce7-8753-afaec5809815 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.424654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.425727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.426018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.426302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.427097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:47.427781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:47.431392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:47.449352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454cb1e-76dd-425b-8961-920f3e1bb9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.450150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454cb1e-76dd-425b-8961-920f3e1bb9cc admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.451067 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454cb1e-76dd-425b-8961-920f3e1bb9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.451067 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454cb1e-76dd-425b-8961-920f3e1bb9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.457159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454cb1e-76dd-425b-8961-920f3e1bb9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:47.459404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454cb1e-76dd-425b-8961-920f3e1bb9cc admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:47.464359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 895/1796] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:47.465319 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:47.482922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e7f0-665a-4239-9faa-a3fb267a507b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.490939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a418098-3e9b-4e24-be1b-b3ba202af09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.491628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418098-3e9b-4e24-be1b-b3ba202af09d admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.491917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418098-3e9b-4e24-be1b-b3ba202af09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.492203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418098-3e9b-4e24-be1b-b3ba202af09d admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.492913 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a418098-3e9b-4e24-be1b-b3ba202af09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:47.494709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 902/1797] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:47.494916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a418098-3e9b-4e24-be1b-b3ba202af09d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:47.497044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454cb1e-76dd-425b-8961-920f3e1bb9cc admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:47.536046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454cb1e-76dd-425b-8961-920f3e1bb9cc admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.555313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd676c7-8585-4688-8ca9-bb579a7d2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.555909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd676c7-8585-4688-8ca9-bb579a7d2d2a admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.556201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd676c7-8585-4688-8ca9-bb579a7d2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.556478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd676c7-8585-4688-8ca9-bb579a7d2d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.557182 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd676c7-8585-4688-8ca9-bb579a7d2d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:47.559161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd676c7-8585-4688-8ca9-bb579a7d2d2a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:47.567214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 896/1798] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:47 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:47.568924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a418098-3e9b-4e24-be1b-b3ba202af09d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:47.599498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 903/1799] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:47 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:47.600359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd676c7-8585-4688-8ca9-bb579a7d2d2a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:47.701115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a418098-3e9b-4e24-be1b-b3ba202af09d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.702557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd676c7-8585-4688-8ca9-bb579a7d2d2a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.710783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118e095-cbc3-459f-a250-7e590e7b6df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.713324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba13167-12d0-4897-99f7-d56b205b7631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.713665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e095-cbc3-459f-a250-7e590e7b6df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.714256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e095-cbc3-459f-a250-7e590e7b6df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.714800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13167-12d0-4897-99f7-d56b205b7631 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.715158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118e095-cbc3-459f-a250-7e590e7b6df3 admin admin] PATH_INFO: `/v3/projects/a19ec05974e342e88ecf333714bc5389/users/c59a08b11301416cbc04dffc46f4b4dd/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.715520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13167-12d0-4897-99f7-d56b205b7631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.717106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba13167-12d0-4897-99f7-d56b205b7631 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.718170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba13167-12d0-4897-99f7-d56b205b7631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:47.720238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118e095-cbc3-459f-a250-7e590e7b6df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19ec05974e342e88ecf333714bc5389, user_id=c59a08b11301416cbc04dffc46f4b4dd, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:47.721899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba13167-12d0-4897-99f7-d56b205b7631 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:47.739418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118e095-cbc3-459f-a250-7e590e7b6df3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:47.756301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 897/1800] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:47 2022] PUT /identity/v3/projects/a19ec05974e342e88ecf333714bc5389/users/c59a08b11301416cbc04dffc46f4b4dd/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:47.765805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118e095-cbc3-459f-a250-7e590e7b6df3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:47.775241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 904/1801] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:47 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:47.780119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a150-c3f7-4dd6-8d0c-1035bc55ad73 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.784170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a150-c3f7-4dd6-8d0c-1035bc55ad73 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.784719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a150-c3f7-4dd6-8d0c-1035bc55ad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:47.883324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8309a150-c3f7-4dd6-8d0c-1035bc55ad73 None None] MFA Rules not processed for user `c59a08b11301416cbc04dffc46f4b4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:47.892084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8309a150-c3f7-4dd6-8d0c-1035bc55ad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:47.979578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118e095-cbc3-459f-a250-7e590e7b6df3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:47.993560 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bdd16-7010-4ede-a359-61dcc23a4562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:47.994881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bdd16-7010-4ede-a359-61dcc23a4562 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:47.996723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bdd16-7010-4ede-a359-61dcc23a4562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:47.999571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bdd16-7010-4ede-a359-61dcc23a4562 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.000846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bdd16-7010-4ede-a359-61dcc23a4562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:48.008358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bdd16-7010-4ede-a359-61dcc23a4562 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:48.061118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 898/1802] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:47 2022] POST /identity/v3/users => generated 282 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:48.063432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bdd16-7010-4ede-a359-61dcc23a4562 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:48.089549 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bdd16-7010-4ede-a359-61dcc23a4562 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:48.108806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea61ecb-8ac4-4ec6-8d2a-084a8010a543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:48.109575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61ecb-8ac4-4ec6-8d2a-084a8010a543 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.109872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61ecb-8ac4-4ec6-8d2a-084a8010a543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.110151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61ecb-8ac4-4ec6-8d2a-084a8010a543 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.111486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea61ecb-8ac4-4ec6-8d2a-084a8010a543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:48.113797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea61ecb-8ac4-4ec6-8d2a-084a8010a543 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:48.143259 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 899/1803] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:48.145647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea61ecb-8ac4-4ec6-8d2a-084a8010a543 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:48.174892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea61ecb-8ac4-4ec6-8d2a-084a8010a543 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:48.178273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 905/1804] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:48.179786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309a150-c3f7-4dd6-8d0c-1035bc55ad73 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:48.186631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:48.187768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.189365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.189365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.199351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:48.205028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:48.213453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309a150-c3f7-4dd6-8d0c-1035bc55ad73 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:48.235488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37213605-efc7-41ed-a854-c82d8166ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:48.238351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37213605-efc7-41ed-a854-c82d8166ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.240297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37213605-efc7-41ed-a854-c82d8166ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.240618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37213605-efc7-41ed-a854-c82d8166ed31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.241394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37213605-efc7-41ed-a854-c82d8166ed31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:48.244786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 900/1805] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:48.246066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:48.247459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37213605-efc7-41ed-a854-c82d8166ed31 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:48.251059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:48.293864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 906/1806] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:48.298251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37213605-efc7-41ed-a854-c82d8166ed31 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:48.331473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37213605-efc7-41ed-a854-c82d8166ed31 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:48.356404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a4329-5d9e-4301-a9c6-737655fc9663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:48.356404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a4329-5d9e-4301-a9c6-737655fc9663 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.356404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a4329-5d9e-4301-a9c6-737655fc9663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.356404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a4329-5d9e-4301-a9c6-737655fc9663 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.361815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a4329-5d9e-4301-a9c6-737655fc9663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:48.363565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a4329-5d9e-4301-a9c6-737655fc9663 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:48.409627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 907/1807] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:48.410220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a4329-5d9e-4301-a9c6-737655fc9663 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:48.439173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125b7f7-04b4-47e1-a76d-599bc1d9554d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:48.442288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a4329-5d9e-4301-a9c6-737655fc9663 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:48.455482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311024d-e2f2-4d11-ade4-5f8dcdb8a8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:48.464157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18de6e2-975a-41b9-b311-bd3bca984146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:48.464535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311024d-e2f2-4d11-ade4-5f8dcdb8a8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.464535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311024d-e2f2-4d11-ade4-5f8dcdb8a8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.464535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311024d-e2f2-4d11-ade4-5f8dcdb8a8e3 admin admin] PATH_INFO: `/v3/projects/70b490d86ac740f1b55bc6ff1a64732d/users/0f7786d336bb42938f72a99bd7d6d1c1/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.464832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18de6e2-975a-41b9-b311-bd3bca984146 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.464832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18de6e2-975a-41b9-b311-bd3bca984146 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.464832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18de6e2-975a-41b9-b311-bd3bca984146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.498978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311024d-e2f2-4d11-ade4-5f8dcdb8a8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b490d86ac740f1b55bc6ff1a64732d, user_id=0f7786d336bb42938f72a99bd7d6d1c1, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:48.508163 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311024d-e2f2-4d11-ade4-5f8dcdb8a8e3 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:48.516395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18de6e2-975a-41b9-b311-bd3bca984146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:48.518260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18de6e2-975a-41b9-b311-bd3bca984146 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:48.543384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 908/1808] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:48 2022] PUT /identity/v3/projects/70b490d86ac740f1b55bc6ff1a64732d/users/0f7786d336bb42938f72a99bd7d6d1c1/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:48.543384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311024d-e2f2-4d11-ade4-5f8dcdb8a8e3 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:48.547252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 901/1809] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:48.551671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba49a-be4a-4eed-9393-1e8257f6f55e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.552683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba49a-be4a-4eed-9393-1e8257f6f55e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.554154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba49a-be4a-4eed-9393-1e8257f6f55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.648387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7d3ba49a-be4a-4eed-9393-1e8257f6f55e None None] MFA Rules not processed for user `0f7786d336bb42938f72a99bd7d6d1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:48.649919 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7d3ba49a-be4a-4eed-9393-1e8257f6f55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:48.770974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311024d-e2f2-4d11-ade4-5f8dcdb8a8e3 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:48.791630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b86a5-ff5d-4b96-96b4-50e9238d0238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:48.792607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b86a5-ff5d-4b96-96b4-50e9238d0238 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.793015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b86a5-ff5d-4b96-96b4-50e9238d0238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.793227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b86a5-ff5d-4b96-96b4-50e9238d0238 admin admin] PATH_INFO: `/v3/projects/e6e62a606de24c30be3cbc08acfd5d5f/users/8f6d3109121444279c7a195810df3500/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.842725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b86a5-ff5d-4b96-96b4-50e9238d0238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e62a606de24c30be3cbc08acfd5d5f, user_id=8f6d3109121444279c7a195810df3500, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:48.849909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b86a5-ff5d-4b96-96b4-50e9238d0238 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:48.897653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 909/1810] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:48 2022] PUT /identity/v3/projects/e6e62a606de24c30be3cbc08acfd5d5f/users/8f6d3109121444279c7a195810df3500/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:48.899211 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7485-65e8-47f8-b467-fc445142eade None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:48.899500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7485-65e8-47f8-b467-fc445142eade None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:48.899778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7485-65e8-47f8-b467-fc445142eade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:48.901829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 902/1811] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:48.906631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba49a-be4a-4eed-9393-1e8257f6f55e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:48.937887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba49a-be4a-4eed-9393-1e8257f6f55e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:48.952268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-bc7f7485-65e8-47f8-b467-fc445142eade None None] MFA Rules not processed for user `8f6d3109121444279c7a195810df3500`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:48.953201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bc7f7485-65e8-47f8-b467-fc445142eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:49.047575 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 910/1812] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:49.048165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f7485-65e8-47f8-b467-fc445142eade None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.050168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bc7f7485-65e8-47f8-b467-fc445142eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:49.070323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8cdc-034f-417b-a137-8e359d108058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:49.071194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8cdc-034f-417b-a137-8e359d108058 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.072174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8cdc-034f-417b-a137-8e359d108058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.072574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8cdc-034f-417b-a137-8e359d108058 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.073386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8cdc-034f-417b-a137-8e359d108058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:49.075713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8cdc-034f-417b-a137-8e359d108058 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:49.111589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 903/1813] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:48 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:38:49.111589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755512-41ae-440e-a25c-8b15156579fe None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.111589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755512-41ae-440e-a25c-8b15156579fe None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.111589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb755512-41ae-440e-a25c-8b15156579fe None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.113472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 904/1814] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:49.114360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755512-41ae-440e-a25c-8b15156579fe None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.141731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f7485-65e8-47f8-b467-fc445142eade None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:49.234420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb755512-41ae-440e-a25c-8b15156579fe None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:49.244900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2295ed-56a4-45bb-becb-45c17a515a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:49.246950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2295ed-56a4-45bb-becb-45c17a515a5b admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.247968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2295ed-56a4-45bb-becb-45c17a515a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.248658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2295ed-56a4-45bb-becb-45c17a515a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.250104 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2295ed-56a4-45bb-becb-45c17a515a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:49.253443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2295ed-56a4-45bb-becb-45c17a515a5b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:49.256790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957d6d9-b2d8-406f-93a6-ae04e65ae90d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:49.257578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957d6d9-b2d8-406f-93a6-ae04e65ae90d service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.258961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957d6d9-b2d8-406f-93a6-ae04e65ae90d service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.259610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957d6d9-b2d8-406f-93a6-ae04e65ae90d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.267003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5957d6d9-b2d8-406f-93a6-ae04e65ae90d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:49.356195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 905/1815] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:49 2022] POST /identity/v3/projects => generated 363 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:49.357892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2295ed-56a4-45bb-becb-45c17a515a5b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.458781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957d6d9-b2d8-406f-93a6-ae04e65ae90d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:49.463115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957d6d9-b2d8-406f-93a6-ae04e65ae90d service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:49.485980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 911/1816] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:49.488291 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbf123-a6cb-49e0-bf33-f01999e6b9a2 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.489881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbf123-a6cb-49e0-bf33-f01999e6b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.489881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbf123-a6cb-49e0-bf33-f01999e6b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.502879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2295ed-56a4-45bb-becb-45c17a515a5b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:49.502879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b29e7-6451-4f3b-8c1b-c362493947cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:49.502879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b29e7-6451-4f3b-8c1b-c362493947cf admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.502879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b29e7-6451-4f3b-8c1b-c362493947cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.503376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b29e7-6451-4f3b-8c1b-c362493947cf admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.505650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b29e7-6451-4f3b-8c1b-c362493947cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:49.512484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b29e7-6451-4f3b-8c1b-c362493947cf admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:49.533862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-fafbf123-a6cb-49e0-bf33-f01999e6b9a2 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:49.535228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-fafbf123-a6cb-49e0-bf33-f01999e6b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:49.557208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 906/1817] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:49 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:49.558266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b29e7-6451-4f3b-8c1b-c362493947cf admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.580121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b29e7-6451-4f3b-8c1b-c362493947cf admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:49.593164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae39f3-fa34-4630-8183-8d34699c468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:49.594023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae39f3-fa34-4630-8183-8d34699c468e admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.594414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae39f3-fa34-4630-8183-8d34699c468e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.594797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae39f3-fa34-4630-8183-8d34699c468e admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.595605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae39f3-fa34-4630-8183-8d34699c468e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:49.597686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae39f3-fa34-4630-8183-8d34699c468e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:49.644445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 907/1818] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:49 2022] POST /identity/v3/users => generated 288 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:49.644445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddc757-bd54-4fb5-a42c-efa24678756b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.645011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddc757-bd54-4fb5-a42c-efa24678756b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.645817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddc757-bd54-4fb5-a42c-efa24678756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.679137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 912/1819] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:38:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:49.680407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbf123-a6cb-49e0-bf33-f01999e6b9a2 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.693083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbf123-a6cb-49e0-bf33-f01999e6b9a2 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:49.698689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-17ddc757-bd54-4fb5-a42c-efa24678756b None None] MFA Rules not processed for user `9707d1901c1c4d0cb31d00305bf8c936`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:49.699562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeae72-341c-4972-8eb3-4386816bfca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:49.699933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-17ddc757-bd54-4fb5-a42c-efa24678756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:49.701434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeae72-341c-4972-8eb3-4386816bfca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.702600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeae72-341c-4972-8eb3-4386816bfca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.703042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeae72-341c-4972-8eb3-4386816bfca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.703891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeae72-341c-4972-8eb3-4386816bfca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:49.706242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeae72-341c-4972-8eb3-4386816bfca2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:49.722659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 913/1820] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:49.723977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeae72-341c-4972-8eb3-4386816bfca2 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.738075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeae72-341c-4972-8eb3-4386816bfca2 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:49.753235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5ea0e-edc8-4771-b5ad-494fa34a4f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:49.755820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5ea0e-edc8-4771-b5ad-494fa34a4f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.756094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5ea0e-edc8-4771-b5ad-494fa34a4f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.757462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5ea0e-edc8-4771-b5ad-494fa34a4f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.767342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5ea0e-edc8-4771-b5ad-494fa34a4f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:49.771332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5ea0e-edc8-4771-b5ad-494fa34a4f0d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:49.802522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 914/1821] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:49.805093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5ea0e-edc8-4771-b5ad-494fa34a4f0d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.825184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5ea0e-edc8-4771-b5ad-494fa34a4f0d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:49.838292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:49.839594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:49.839888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:49.841380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] PATH_INFO: `/v3/projects/b844e5e4f0bb4944853fb5407faf9dc4/users/2dd92e7c902f469ea82a8f9773cab38b/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:49.869126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 908/1822] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:49.870054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddc757-bd54-4fb5-a42c-efa24678756b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.872225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b844e5e4f0bb4944853fb5407faf9dc4, user_id=2dd92e7c902f469ea82a8f9773cab38b, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:49.877214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:49.893426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddc757-bd54-4fb5-a42c-efa24678756b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:49.897358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 915/1823] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:49 2022] PUT /identity/v3/projects/b844e5e4f0bb4944853fb5407faf9dc4/users/2dd92e7c902f469ea82a8f9773cab38b/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:49.898744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:49.901801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:49.995548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc754e-01c6-44cc-bba9-c010dbc348d0 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.012570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.012700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be628d-786f-48ca-8a20-054346f86568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.013924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.014267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.014444 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be628d-786f-48ca-8a20-054346f86568 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.014520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.014826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be628d-786f-48ca-8a20-054346f86568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.015764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be628d-786f-48ca-8a20-054346f86568 admin admin] PATH_INFO: `/v3/projects/70439a89d6e14cae9365244e0eabe603/users/ec65e8148fb942d698c5b830157f966f/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.026336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.028749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.034973 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be628d-786f-48ca-8a20-054346f86568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70439a89d6e14cae9365244e0eabe603, user_id=ec65e8148fb942d698c5b830157f966f, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.039108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be628d-786f-48ca-8a20-054346f86568 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.042791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 916/1824] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:50.043987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.046065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:50.057626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 909/1825] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:49 2022] PUT /identity/v3/projects/70439a89d6e14cae9365244e0eabe603/users/ec65e8148fb942d698c5b830157f966f/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:50.059005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be628d-786f-48ca-8a20-054346f86568 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.065956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1dd38-76ce-48ce-b59a-546702fae9ef service nova] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.135992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c65ae8-13ae-420c-ab7e-bdd662ddb9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.138258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65ae8-13ae-420c-ab7e-bdd662ddb9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.139089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65ae8-13ae-420c-ab7e-bdd662ddb9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.139456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65ae8-13ae-420c-ab7e-bdd662ddb9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.140127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c65ae8-13ae-420c-ab7e-bdd662ddb9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.143986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c65ae8-13ae-420c-ab7e-bdd662ddb9c7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.157909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be628d-786f-48ca-8a20-054346f86568 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.164644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367859c6-30bb-45d7-a670-29febe2bc6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.165332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367859c6-30bb-45d7-a670-29febe2bc6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.165675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367859c6-30bb-45d7-a670-29febe2bc6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.165916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367859c6-30bb-45d7-a670-29febe2bc6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.167279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367859c6-30bb-45d7-a670-29febe2bc6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.169110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367859c6-30bb-45d7-a670-29febe2bc6ba admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.181153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 917/1826] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:50 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:50.182314 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c65ae8-13ae-420c-ab7e-bdd662ddb9c7 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.188055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 910/1827] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:50.189345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367859c6-30bb-45d7-a670-29febe2bc6ba admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.204064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367859c6-30bb-45d7-a670-29febe2bc6ba admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.276735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c65ae8-13ae-420c-ab7e-bdd662ddb9c7 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.287707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674c3e-44ae-46f5-a26f-aca9ca060c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.287823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7b851-6572-4278-a54c-df658e26de10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.287823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7b851-6572-4278-a54c-df658e26de10 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.287995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674c3e-44ae-46f5-a26f-aca9ca060c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.288088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7b851-6572-4278-a54c-df658e26de10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.288167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674c3e-44ae-46f5-a26f-aca9ca060c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.288251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7b851-6572-4278-a54c-df658e26de10 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.288334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd674c3e-44ae-46f5-a26f-aca9ca060c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.288419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7b851-6572-4278-a54c-df658e26de10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.288505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd674c3e-44ae-46f5-a26f-aca9ca060c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.288505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd674c3e-44ae-46f5-a26f-aca9ca060c50 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.289145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7b851-6572-4278-a54c-df658e26de10 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.300968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 918/1828] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:50.300968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674c3e-44ae-46f5-a26f-aca9ca060c50 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.309703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd674c3e-44ae-46f5-a26f-aca9ca060c50 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.312568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 911/1829] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:50 2022] POST /identity/v3/users => generated 309 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:50.313453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7b851-6572-4278-a54c-df658e26de10 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.317397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560757ee-bee7-4ac9-af06-ff529cc86278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.318326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560757ee-bee7-4ac9-af06-ff529cc86278 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.318795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560757ee-bee7-4ac9-af06-ff529cc86278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.319073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560757ee-bee7-4ac9-af06-ff529cc86278 admin admin] PATH_INFO: `/v3/projects/b844e5e4f0bb4944853fb5407faf9dc4/users/2dd92e7c902f469ea82a8f9773cab38b/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.321150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560757ee-bee7-4ac9-af06-ff529cc86278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b844e5e4f0bb4944853fb5407faf9dc4, user_id=2dd92e7c902f469ea82a8f9773cab38b, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.323092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7b851-6572-4278-a54c-df658e26de10 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.323957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560757ee-bee7-4ac9-af06-ff529cc86278 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.329120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c59ea-e984-4fa8-a51b-027e817fddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.330215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c59ea-e984-4fa8-a51b-027e817fddc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.330556 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c59ea-e984-4fa8-a51b-027e817fddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.330898 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c59ea-e984-4fa8-a51b-027e817fddc4 admin admin] PATH_INFO: `/v3/projects/70439a89d6e14cae9365244e0eabe603/users/ec65e8148fb942d698c5b830157f966f/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.332944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c59ea-e984-4fa8-a51b-027e817fddc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70439a89d6e14cae9365244e0eabe603, user_id=ec65e8148fb942d698c5b830157f966f, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.335581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 919/1830] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:50 2022] PUT /identity/v3/projects/b844e5e4f0bb4944853fb5407faf9dc4/users/2dd92e7c902f469ea82a8f9773cab38b/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:50.335686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c59ea-e984-4fa8-a51b-027e817fddc4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.336447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560757ee-bee7-4ac9-af06-ff529cc86278 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.347896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 912/1831] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:50 2022] PUT /identity/v3/projects/70439a89d6e14cae9365244e0eabe603/users/ec65e8148fb942d698c5b830157f966f/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:50.349156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253e621-7f67-4e44-8422-c78e5a523b43 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.349577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253e621-7f67-4e44-8422-c78e5a523b43 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.349971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253e621-7f67-4e44-8422-c78e5a523b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.378592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4253e621-7f67-4e44-8422-c78e5a523b43 None None] MFA Rules not processed for user `2dd92e7c902f469ea82a8f9773cab38b`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:50.380167 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4253e621-7f67-4e44-8422-c78e5a523b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:50.400789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560757ee-bee7-4ac9-af06-ff529cc86278 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.446860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 913/1832] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:50.448450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f57d-f787-4d12-b890-3348d116c2e4 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.448938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f57d-f787-4d12-b890-3348d116c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.449398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7f57d-f787-4d12-b890-3348d116c2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.460586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ca2ea-d1bd-4a7c-858a-92097c333159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.461317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ca2ea-d1bd-4a7c-858a-92097c333159 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.461653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ca2ea-d1bd-4a7c-858a-92097c333159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.461928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ca2ea-d1bd-4a7c-858a-92097c333159 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.462948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ca2ea-d1bd-4a7c-858a-92097c333159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.464576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ca2ea-d1bd-4a7c-858a-92097c333159 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.478251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 920/1833] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:50.478251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ca2ea-d1bd-4a7c-858a-92097c333159 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.478474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0ed7f57d-f787-4d12-b890-3348d116c2e4 None None] MFA Rules not processed for user `ec65e8148fb942d698c5b830157f966f`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:50.479377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0ed7f57d-f787-4d12-b890-3348d116c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:50.528148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ca2ea-d1bd-4a7c-858a-92097c333159 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.532298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb37c8-d8a6-42ba-98bb-c4b86ca93710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.532969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb37c8-d8a6-42ba-98bb-c4b86ca93710 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.533246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb37c8-d8a6-42ba-98bb-c4b86ca93710 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.533687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb37c8-d8a6-42ba-98bb-c4b86ca93710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.544400 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb37c8-d8a6-42ba-98bb-c4b86ca93710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.546549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb37c8-d8a6-42ba-98bb-c4b86ca93710 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.551214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 914/1834] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:50.552009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f57d-f787-4d12-b890-3348d116c2e4 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.565692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 921/1835] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:50.566607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7f57d-f787-4d12-b890-3348d116c2e4 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.566963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb37c8-d8a6-42ba-98bb-c4b86ca93710 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.571989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd62e-4857-4859-b637-858d2951616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.572968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd62e-4857-4859-b637-858d2951616f admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.573843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd62e-4857-4859-b637-858d2951616f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.574173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd62e-4857-4859-b637-858d2951616f admin admin] PATH_INFO: `/v3/projects/ac4b527673d44795b399f44e6447afb5/users/768133d9c7c94411b8869fdc4457aa2f/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.581484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb37c8-d8a6-42ba-98bb-c4b86ca93710 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.585387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cedc5-3c3c-48cf-b6e5-092c2b56975a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.586308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cedc5-3c3c-48cf-b6e5-092c2b56975a service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.586598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cedc5-3c3c-48cf-b6e5-092c2b56975a service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.587378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cedc5-3c3c-48cf-b6e5-092c2b56975a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.595632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd62e-4857-4859-b637-858d2951616f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4b527673d44795b399f44e6447afb5, user_id=768133d9c7c94411b8869fdc4457aa2f, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.598605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd62e-4857-4859-b637-858d2951616f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.625464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cedc5-3c3c-48cf-b6e5-092c2b56975a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.627121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cedc5-3c3c-48cf-b6e5-092c2b56975a service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.631795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 915/1836] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:50 2022] PUT /identity/v3/projects/ac4b527673d44795b399f44e6447afb5/users/768133d9c7c94411b8869fdc4457aa2f/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:50.636267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd62e-4857-4859-b637-858d2951616f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.661495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 922/1837] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:50.724288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd62e-4857-4859-b637-858d2951616f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.732308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de397194-26d7-4738-83da-18b6cb39167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.733094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de397194-26d7-4738-83da-18b6cb39167d admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.733435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de397194-26d7-4738-83da-18b6cb39167d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.733673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de397194-26d7-4738-83da-18b6cb39167d admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.734511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de397194-26d7-4738-83da-18b6cb39167d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.736950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de397194-26d7-4738-83da-18b6cb39167d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.755225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 916/1838] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:50.761579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cedc5-3c3c-48cf-b6e5-092c2b56975a service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.768932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de397194-26d7-4738-83da-18b6cb39167d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:50.773919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cedc5-3c3c-48cf-b6e5-092c2b56975a service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.779766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e72fb-dcfc-43ba-a1bb-ff81e7857f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.780662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e72fb-dcfc-43ba-a1bb-ff81e7857f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.781340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e72fb-dcfc-43ba-a1bb-ff81e7857f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.781340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e72fb-dcfc-43ba-a1bb-ff81e7857f58 admin admin] PATH_INFO: `/v3/projects/ac4b527673d44795b399f44e6447afb5/users/768133d9c7c94411b8869fdc4457aa2f/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:50.783323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e72fb-dcfc-43ba-a1bb-ff81e7857f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4b527673d44795b399f44e6447afb5, user_id=768133d9c7c94411b8869fdc4457aa2f, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:50.786578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e72fb-dcfc-43ba-a1bb-ff81e7857f58 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:50.797133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 923/1839] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:50 2022] PUT /identity/v3/projects/ac4b527673d44795b399f44e6447afb5/users/768133d9c7c94411b8869fdc4457aa2f/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:50.875746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de397194-26d7-4738-83da-18b6cb39167d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:50.975356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2403-315e-48d3-9c71-35938e4f98f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:50.976599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2403-315e-48d3-9c71-35938e4f98f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:50.977114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2403-315e-48d3-9c71-35938e4f98f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:50.977687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2403-315e-48d3-9c71-35938e4f98f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:51.091731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f2403-315e-48d3-9c71-35938e4f98f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:51.094034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f2403-315e-48d3-9c71-35938e4f98f1 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:51.133857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 917/1840] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:51.286920 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e72fb-dcfc-43ba-a1bb-ff81e7857f58 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:51.422949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e72fb-dcfc-43ba-a1bb-ff81e7857f58 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:51.436264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd92e7c902f469ea82a8f9773cab38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b844e5e4f0bb4944853fb5407faf9dc4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:51.437028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:51.437315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:51.437620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:51.438764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:51.438764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:51.443862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:51.472971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 924/1841] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:51.478215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2403-315e-48d3-9c71-35938e4f98f1 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:51.500062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2403-315e-48d3-9c71-35938e4f98f1 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:51.507091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a80ca9-d167-43f3-96af-9f9a0f18727e tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd92e7c902f469ea82a8f9773cab38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b844e5e4f0bb4944853fb5407faf9dc4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:51.507814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a80ca9-d167-43f3-96af-9f9a0f18727e tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:51.508253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a80ca9-d167-43f3-96af-9f9a0f18727e tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:51.508538 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a80ca9-d167-43f3-96af-9f9a0f18727e tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:51.509283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a80ca9-d167-43f3-96af-9f9a0f18727e tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:51.513994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a80ca9-d167-43f3-96af-9f9a0f18727e tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:51.597814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 918/1842] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:51 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:51.601561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:51.617610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75c33-3343-411b-afb7-9796aa646d46 tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:51.716138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd92e7c902f469ea82a8f9773cab38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b844e5e4f0bb4944853fb5407faf9dc4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:51.718777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:51.719397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:51.719972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:51.721326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:51.723991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:51.731589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:51.773815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 925/1843] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:51.886617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a80ca9-d167-43f3-96af-9f9a0f18727e tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:51.902156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a80ca9-d167-43f3-96af-9f9a0f18727e tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:51.916949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dd92e7c902f469ea82a8f9773cab38b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b844e5e4f0bb4944853fb5407faf9dc4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:51.918066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:51.918360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:51.918649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] PATH_INFO: `/v3/projects/a7bfe34cc5fb47099d28432b0cee9bda` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:51.922166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a7bfe34cc5fb47099d28432b0cee9bda)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:51.931657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:52.068173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bfe34cc5fb47099d28432b0cee9bda', 'request_id': 'req-8df48d10-bb93-4d15-9657-66fb3c09fc2f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.087445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bfe34cc5fb47099d28432b0cee9bda', 'request_id': 'req-8df48d10-bb93-4d15-9657-66fb3c09fc2f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.118617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bfe34cc5fb47099d28432b0cee9bda', 'request_id': 'req-8df48d10-bb93-4d15-9657-66fb3c09fc2f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.162635 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] The token cache is being invalidate because project a7bfe34cc5fb47099d28432b0cee9bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:52.162961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.163800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8df48d10-bb93-4d15-9657-66fb3c09fc2f tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.165592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 919/1844] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:51 2022] DELETE /identity/v3/projects/a7bfe34cc5fb47099d28432b0cee9bda => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:52.642733 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:52.644579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:52.736213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb5bfa-a0e0-4ad9-ba5d-f9d049c4c9fe tempest-VolumeQuotaClassesTest-353626763 tempest-VolumeQuotaClassesTest-353626763-project-admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:52.762491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdaa8-c6a6-4aa1-bd93-7977297a7d0a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:52.763012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdaa8-c6a6-4aa1-bd93-7977297a7d0a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:52.763153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdaa8-c6a6-4aa1-bd93-7977297a7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:52.790298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-510cdaa8-c6a6-4aa1-bd93-7977297a7d0a None None] MFA Rules not processed for user `768133d9c7c94411b8869fdc4457aa2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:52.791641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-510cdaa8-c6a6-4aa1-bd93-7977297a7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:52.811460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:52.812345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:52.812624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:52.812903 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] PATH_INFO: `/v3/users/0f7786d336bb42938f72a99bd7d6d1c1` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:52.814129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7786d336bb42938f72a99bd7d6d1c1)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:52.816456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:52.867052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 920/1845] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:52.873980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7786d336bb42938f72a99bd7d6d1c1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.885898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7786d336bb42938f72a99bd7d6d1c1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.893298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7786d336bb42938f72a99bd7d6d1c1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.893918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7786d336bb42938f72a99bd7d6d1c1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.904305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7786d336bb42938f72a99bd7d6d1c1'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:52.913699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 926/1846] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:52 2022] DELETE /identity/v3/users/0f7786d336bb42938f72a99bd7d6d1c1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:52.918843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5520-103f-4340-afbf-eed5ad621663 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:52.918843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5520-103f-4340-afbf-eed5ad621663 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:52.918843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d5520-103f-4340-afbf-eed5ad621663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:52.938697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8c3d5520-103f-4340-afbf-eed5ad621663 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:52.940157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8c3d5520-103f-4340-afbf-eed5ad621663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:53.003036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 921/1847] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:53.013372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:53.015119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:53.074974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43ec76-fb07-4454-93da-ecc5ff103806 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:53.078631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b119593-4387-465a-9926-fcb57dd63605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:53.079281 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119593-4387-465a-9926-fcb57dd63605 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:53.079559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119593-4387-465a-9926-fcb57dd63605 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:53.079830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b119593-4387-465a-9926-fcb57dd63605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:53.088697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b119593-4387-465a-9926-fcb57dd63605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:53.090155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b119593-4387-465a-9926-fcb57dd63605 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:53.100095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 927/1848] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:53.356726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d5520-103f-4340-afbf-eed5ad621663 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:53.358340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8c3d5520-103f-4340-afbf-eed5ad621663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:53.372300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d5520-103f-4340-afbf-eed5ad621663 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:53.378685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:53.379582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:53.379868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:53.380131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] PATH_INFO: `/v3/projects/70b490d86ac740f1b55bc6ff1a64732d` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:53.381389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b490d86ac740f1b55bc6ff1a64732d)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:53.383378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:53.431908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b490d86ac740f1b55bc6ff1a64732d', 'request_id': 'req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.437178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b490d86ac740f1b55bc6ff1a64732d', 'request_id': 'req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.444749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b490d86ac740f1b55bc6ff1a64732d', 'request_id': 'req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.457007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] The token cache is being invalidate because project 70b490d86ac740f1b55bc6ff1a64732d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:53.457300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.457974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.459600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 922/1849] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:53 2022] DELETE /identity/v3/projects/70b490d86ac740f1b55bc6ff1a64732d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:53.463605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b119593-4387-465a-9926-fcb57dd63605 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:53.473855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b119593-4387-465a-9926-fcb57dd63605 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:53.551272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:53.552066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:53.552344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:53.552621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] PATH_INFO: `/v3/users/2dd92e7c902f469ea82a8f9773cab38b` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:53.553832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd92e7c902f469ea82a8f9773cab38b)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:53.555736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:53.656806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd92e7c902f469ea82a8f9773cab38b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.671665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd92e7c902f469ea82a8f9773cab38b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.682485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd92e7c902f469ea82a8f9773cab38b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.683237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd92e7c902f469ea82a8f9773cab38b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.692918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-23f1b1df-f0ce-4b74-9946-558e3d7c6d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd92e7c902f469ea82a8f9773cab38b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.704056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 928/1850] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:53 2022] DELETE /identity/v3/users/2dd92e7c902f469ea82a8f9773cab38b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:53.728556 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:53.729995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:53.742413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63f33b-e6b5-47b8-9b66-c6bf123de69e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:53.839991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:53.841579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:53.841971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:53.842346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] PATH_INFO: `/v3/users/8f6d3109121444279c7a195810df3500` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:53.844352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6d3109121444279c7a195810df3500)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:53.846653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:53.922342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6d3109121444279c7a195810df3500'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.942992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6d3109121444279c7a195810df3500'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.943984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6d3109121444279c7a195810df3500'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.953529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6d3109121444279c7a195810df3500'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.954730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6d3109121444279c7a195810df3500'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:53.971471 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 923/1851] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:53 2022] DELETE /identity/v3/users/8f6d3109121444279c7a195810df3500 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:53.975649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fbff-71d7-4604-b62b-702ac4290eda None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:53.975955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fbff-71d7-4604-b62b-702ac4290eda None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:53.976214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fbff-71d7-4604-b62b-702ac4290eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:53.995768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b209fbff-71d7-4604-b62b-702ac4290eda None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:53.996974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b209fbff-71d7-4604-b62b-702ac4290eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:54.070166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.071786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:54.073513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 929/1852] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:54.083380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209fbff-71d7-4604-b62b-702ac4290eda None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.084612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f71a6d-ad9e-4c7d-9f1d-8cbb3ce000a8 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.085438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b209fbff-71d7-4604-b62b-702ac4290eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:54.089292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.090196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.090483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.090760 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] PATH_INFO: `/v3/projects/b844e5e4f0bb4944853fb5407faf9dc4` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.091992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b844e5e4f0bb4944853fb5407faf9dc4)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.093931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.156671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b844e5e4f0bb4944853fb5407faf9dc4', 'request_id': 'req-e7ca4236-0b32-4f93-ac86-be5839405656'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.161929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209fbff-71d7-4604-b62b-702ac4290eda None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.163150 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b844e5e4f0bb4944853fb5407faf9dc4', 'request_id': 'req-e7ca4236-0b32-4f93-ac86-be5839405656'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.172332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b844e5e4f0bb4944853fb5407faf9dc4', 'request_id': 'req-e7ca4236-0b32-4f93-ac86-be5839405656'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.184043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] The token cache is being invalidate because project b844e5e4f0bb4944853fb5407faf9dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:54.184335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.185079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e7ca4236-0b32-4f93-ac86-be5839405656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.187378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 924/1853] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:54 2022] DELETE /identity/v3/projects/b844e5e4f0bb4944853fb5407faf9dc4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:38:54.192293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a863ef-0dd7-499c-8427-e91fc6944232 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.192615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a863ef-0dd7-499c-8427-e91fc6944232 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.192867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a863ef-0dd7-499c-8427-e91fc6944232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.212290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-66a863ef-0dd7-499c-8427-e91fc6944232 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:54.213514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-66a863ef-0dd7-499c-8427-e91fc6944232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:54.222273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.223441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.223848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.224723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.227288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:54.281342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 925/1854] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:54.283154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c994e-2408-41dd-bad8-2be590a8693a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.283638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c994e-2408-41dd-bad8-2be590a8693a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.284133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c994e-2408-41dd-bad8-2be590a8693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.294967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.296410 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.304143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c41c994e-2408-41dd-bad8-2be590a8693a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:54.305885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c41c994e-2408-41dd-bad8-2be590a8693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:54.306022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 930/1855] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:38:54.316520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 926/1856] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:54.320621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.330219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09dff-fb65-4428-9165-65d9d9a297c1 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.334930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.335730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.335885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.336142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.336865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:54.337172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.338797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.352819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 931/1857] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:54.358019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c994e-2408-41dd-bad8-2be590a8693a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.367867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c994e-2408-41dd-bad8-2be590a8693a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.373894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.374636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.375058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.375351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.376159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.378173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.415320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 927/1858] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:54 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:38:54.416627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.427722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e064-d64e-4671-84a0-e69d1b861d86 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.499186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146b65-6fe4-4907-85f1-b6a83c947c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.499869 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146b65-6fe4-4907-85f1-b6a83c947c92 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.500155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146b65-6fe4-4907-85f1-b6a83c947c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.500427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146b65-6fe4-4907-85f1-b6a83c947c92 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.501328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1146b65-6fe4-4907-85f1-b6a83c947c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.503527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1146b65-6fe4-4907-85f1-b6a83c947c92 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.535703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 932/1859] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:54 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:38:54.539183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.541338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:54.552053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146b65-6fe4-4907-85f1-b6a83c947c92 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.560651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6b409-7ac7-4f0a-a860-940a9b12974e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.566995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.568201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.568629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.569038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] PATH_INFO: `/v3/users/9707d1901c1c4d0cb31d00305bf8c936` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.570101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146b65-6fe4-4907-85f1-b6a83c947c92 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.570725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9707d1901c1c4d0cb31d00305bf8c936)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.575206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.575347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dc789-e50d-40ac-bf13-70738c5b6c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.576182 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dc789-e50d-40ac-bf13-70738c5b6c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.576564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dc789-e50d-40ac-bf13-70738c5b6c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.577866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dc789-e50d-40ac-bf13-70738c5b6c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.577866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dc789-e50d-40ac-bf13-70738c5b6c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.579904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dc789-e50d-40ac-bf13-70738c5b6c75 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.595177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 933/1860] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:54.599626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dc789-e50d-40ac-bf13-70738c5b6c75 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.614449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dc789-e50d-40ac-bf13-70738c5b6c75 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.620308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abae97-9dc4-40a4-b056-d165069d7d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.621146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abae97-9dc4-40a4-b056-d165069d7d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.621523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abae97-9dc4-40a4-b056-d165069d7d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.622006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abae97-9dc4-40a4-b056-d165069d7d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.622891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abae97-9dc4-40a4-b056-d165069d7d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.624679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abae97-9dc4-40a4-b056-d165069d7d45 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.641961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 934/1861] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:54.644216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abae97-9dc4-40a4-b056-d165069d7d45 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.648846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9707d1901c1c4d0cb31d00305bf8c936'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.657343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abae97-9dc4-40a4-b056-d165069d7d45 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:54.663839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9707d1901c1c4d0cb31d00305bf8c936'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.664689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9707d1901c1c4d0cb31d00305bf8c936'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.665587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:54.666719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.667096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.667574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] PATH_INFO: `/v3/projects/7a507bbecfc149f6987ac7b881b0b1b3/users/c0aedd5d711b4f59948e601e64aad323/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.672938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9707d1901c1c4d0cb31d00305bf8c936'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.673751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f6e209b5-77c8-4e83-99ad-3ccb155ef1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9707d1901c1c4d0cb31d00305bf8c936'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:54.687615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a507bbecfc149f6987ac7b881b0b1b3, user_id=c0aedd5d711b4f59948e601e64aad323, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:54.690782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:54.698748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 928/1862] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:54 2022] DELETE /identity/v3/users/9707d1901c1c4d0cb31d00305bf8c936 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:54.721672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 935/1863] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:54 2022] PUT /identity/v3/projects/7a507bbecfc149f6987ac7b881b0b1b3/users/c0aedd5d711b4f59948e601e64aad323/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:54.724499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabdf97-18fe-4b3a-a361-a9de3e03a597 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:54.725015 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabdf97-18fe-4b3a-a361-a9de3e03a597 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:54.725522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabdf97-18fe-4b3a-a361-a9de3e03a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:54.761425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-efabdf97-18fe-4b3a-a361-a9de3e03a597 None None] MFA Rules not processed for user `c0aedd5d711b4f59948e601e64aad323`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:54.763525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-efabdf97-18fe-4b3a-a361-a9de3e03a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:54.980860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 929/1864] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:54.985774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:54.987821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.118613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bce4ef-f7c2-44aa-8840-3ddbf3141e70 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:55.141379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:55.145753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.146176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.146586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.155767 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b171-a9ec-44b8-82d5-760a73c70b3c None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.156189 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b171-a9ec-44b8-82d5-760a73c70b3c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.156594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b171-a9ec-44b8-82d5-760a73c70b3c None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.160763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 930/1865] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:38:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:38:55.160923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:55.170776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9278b22-f0e0-4b31-8fa7-dccd761966aa None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.171729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9278b22-f0e0-4b31-8fa7-dccd761966aa None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.172279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9278b22-f0e0-4b31-8fa7-dccd761966aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.179693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:55.231054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f9278b22-f0e0-4b31-8fa7-dccd761966aa None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:55.232955 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f9278b22-f0e0-4b31-8fa7-dccd761966aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.254329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 936/1866] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:54 2022] POST /identity/v3/projects => generated 389 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:55.260093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:55.265589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.357063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2b9fd-5f1d-4002-888b-f2294385dcf2 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:55.362849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:55.363725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.364001 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.364274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] PATH_INFO: `/v3/projects/bf9c71e905dc4720999680442312b458` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.365459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9c71e905dc4720999680442312b458)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:55.367800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:55.367924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 931/1867] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:38:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:55.370484 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9278b22-f0e0-4b31-8fa7-dccd761966aa None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:55.374506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f9278b22-f0e0-4b31-8fa7-dccd761966aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.402954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9278b22-f0e0-4b31-8fa7-dccd761966aa None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:55.410100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:55.411016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.411304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.411747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] PATH_INFO: `/v3/projects/e6e62a606de24c30be3cbc08acfd5d5f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.413150 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e62a606de24c30be3cbc08acfd5d5f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:55.415137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:55.436220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9c71e905dc4720999680442312b458', 'request_id': 'req-7bbc8889-9196-4596-a2bc-f59a39a0d22b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.442443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9c71e905dc4720999680442312b458', 'request_id': 'req-7bbc8889-9196-4596-a2bc-f59a39a0d22b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.453626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9c71e905dc4720999680442312b458', 'request_id': 'req-7bbc8889-9196-4596-a2bc-f59a39a0d22b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.474009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] The token cache is being invalidate because project bf9c71e905dc4720999680442312b458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:55.474306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.476051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.482854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 937/1868] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:55 2022] DELETE /identity/v3/projects/bf9c71e905dc4720999680442312b458 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:55.482854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:55.484319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.484536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e62a606de24c30be3cbc08acfd5d5f', 'request_id': 'req-b310b60f-67d5-4b4a-839a-78da93586221'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.493815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e62a606de24c30be3cbc08acfd5d5f', 'request_id': 'req-b310b60f-67d5-4b4a-839a-78da93586221'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.506528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e62a606de24c30be3cbc08acfd5d5f', 'request_id': 'req-b310b60f-67d5-4b4a-839a-78da93586221'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.556822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] The token cache is being invalidate because project e6e62a606de24c30be3cbc08acfd5d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:55.557184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.557948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.560658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 932/1869] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:55 2022] DELETE /identity/v3/projects/e6e62a606de24c30be3cbc08acfd5d5f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:55.561473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:55.563153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.631614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc8889-9196-4596-a2bc-f59a39a0d22b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:55.644273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:55.645192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.645648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.645822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310b60f-67d5-4b4a-839a-78da93586221 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:55.646158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.647074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:55.649683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:55.652021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:55.653095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.653532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.654115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] PATH_INFO: `/v3/users/768133d9c7c94411b8869fdc4457aa2f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.655690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768133d9c7c94411b8869fdc4457aa2f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:55.657869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:55.677034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 938/1870] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:55 2022] POST /identity/v3/users => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:55.681726 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:55.683852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.741254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768133d9c7c94411b8869fdc4457aa2f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.764921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768133d9c7c94411b8869fdc4457aa2f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.771039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768133d9c7c94411b8869fdc4457aa2f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.782336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768133d9c7c94411b8869fdc4457aa2f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.786039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768133d9c7c94411b8869fdc4457aa2f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:55.802633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc782b8a-ad9e-41a9-9397-8e7902dece1f admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:55.823162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:55.824091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 933/1871] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:55 2022] DELETE /identity/v3/users/768133d9c7c94411b8869fdc4457aa2f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:55.824917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.825024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:55.825599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.826049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.828599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.828940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.845828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:55.847842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:55.863382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 939/1872] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:55.864542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:55.866203 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:55.881898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12261-d978-4d3f-9b0b-7a46ed9d250d service nova] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:55.945013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab995cb2-d618-49de-a7da-4568dc33b5f7 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:55.951449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:55.952320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.952779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.953072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] PATH_INFO: `/v3/users/ec65e8148fb942d698c5b830157f966f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.955193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec65e8148fb942d698c5b830157f966f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:55.961995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:55.995631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f3ef2-899b-4125-8b4e-428a85180ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:55.996206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f3ef2-899b-4125-8b4e-428a85180ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:55.996541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f3ef2-899b-4125-8b4e-428a85180ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:55.996841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f3ef2-899b-4125-8b4e-428a85180ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:55.997929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f3ef2-899b-4125-8b4e-428a85180ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:56.000855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f3ef2-899b-4125-8b4e-428a85180ef4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:56.031047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 940/1873] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:56.032174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f3ef2-899b-4125-8b4e-428a85180ef4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:56.046265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f3ef2-899b-4125-8b4e-428a85180ef4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:56.060518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423c6f4-f7a1-4b4c-8902-46256d9d3e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:56.062101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423c6f4-f7a1-4b4c-8902-46256d9d3e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:56.063769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423c6f4-f7a1-4b4c-8902-46256d9d3e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:56.065101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec65e8148fb942d698c5b830157f966f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.066651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423c6f4-f7a1-4b4c-8902-46256d9d3e32 admin admin] PATH_INFO: `/v3/projects/e3e4087f0c4d40d8b2bfe21c0a00a8cd/users/8906e52a21c04fc1a146bc87c12408c6/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:56.084677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec65e8148fb942d698c5b830157f966f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.085877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec65e8148fb942d698c5b830157f966f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.092670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423c6f4-f7a1-4b4c-8902-46256d9d3e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e4087f0c4d40d8b2bfe21c0a00a8cd, user_id=8906e52a21c04fc1a146bc87c12408c6, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:56.097114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423c6f4-f7a1-4b4c-8902-46256d9d3e32 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:56.101732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec65e8148fb942d698c5b830157f966f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.104688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec65e8148fb942d698c5b830157f966f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.125711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 934/1874] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:55 2022] DELETE /identity/v3/users/ec65e8148fb942d698c5b830157f966f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:56.132806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 941/1875] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:56 2022] PUT /identity/v3/projects/e3e4087f0c4d40d8b2bfe21c0a00a8cd/users/8906e52a21c04fc1a146bc87c12408c6/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:56.136854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:56.138814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:56.209399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f27781-f2ac-41b7-bca0-ea60e3c9a674 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:56.290579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614dd4-0251-46d0-9098-d1060da35e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:56.291367 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614dd4-0251-46d0-9098-d1060da35e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:56.291655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614dd4-0251-46d0-9098-d1060da35e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:56.291933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614dd4-0251-46d0-9098-d1060da35e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:56.293820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69614dd4-0251-46d0-9098-d1060da35e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:56.297096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69614dd4-0251-46d0-9098-d1060da35e9e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:56.310433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 935/1876] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:56.314489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423c6f4-f7a1-4b4c-8902-46256d9d3e32 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:56.333173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423c6f4-f7a1-4b4c-8902-46256d9d3e32 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:56.338358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:56.339272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:56.339551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:56.339823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] PATH_INFO: `/v3/projects/e3e4087f0c4d40d8b2bfe21c0a00a8cd/users/8906e52a21c04fc1a146bc87c12408c6/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:56.342751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e4087f0c4d40d8b2bfe21c0a00a8cd, user_id=8906e52a21c04fc1a146bc87c12408c6, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:56.346108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:56.359844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 942/1877] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:56 2022] PUT /identity/v3/projects/e3e4087f0c4d40d8b2bfe21c0a00a8cd/users/8906e52a21c04fc1a146bc87c12408c6/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:56.369903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f4951-880b-405f-bb75-dafc4db65f4d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:56.370603 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f4951-880b-405f-bb75-dafc4db65f4d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:56.371144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f4951-880b-405f-bb75-dafc4db65f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:56.404712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-069f4951-880b-405f-bb75-dafc4db65f4d None None] MFA Rules not processed for user `8906e52a21c04fc1a146bc87c12408c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:56.406179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-069f4951-880b-405f-bb75-dafc4db65f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:56.518683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 936/1878] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:56.530446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:56.532285 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:56.632688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd70350-54d6-468b-9529-ee234dad8231 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:56.637775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37e033-e56a-4840-9ebb-f7c9a32977bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:56.639971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e033-e56a-4840-9ebb-f7c9a32977bf service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:56.640402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e033-e56a-4840-9ebb-f7c9a32977bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:56.640799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37e033-e56a-4840-9ebb-f7c9a32977bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:56.654774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37e033-e56a-4840-9ebb-f7c9a32977bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:56.656839 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37e033-e56a-4840-9ebb-f7c9a32977bf service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:56.667548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 943/1879] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:56.714573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f4951-880b-405f-bb75-dafc4db65f4d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:56.714573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-069f4951-880b-405f-bb75-dafc4db65f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:56.724985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37e033-e56a-4840-9ebb-f7c9a32977bf service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:56.734664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37e033-e56a-4840-9ebb-f7c9a32977bf service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:56.740550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6563d-220f-477b-bf2f-a17e6816e170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:56.741620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6563d-220f-477b-bf2f-a17e6816e170 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:56.742149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6563d-220f-477b-bf2f-a17e6816e170 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:56.742617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6563d-220f-477b-bf2f-a17e6816e170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:56.751007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d1d6563d-220f-477b-bf2f-a17e6816e170 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:56.814992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f4951-880b-405f-bb75-dafc4db65f4d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:56.822066 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:56.823105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:56.823494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:56.823682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] PATH_INFO: `/v3/projects/ac4b527673d44795b399f44e6447afb5` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:56.825311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4b527673d44795b399f44e6447afb5)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:56.828089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:56.834792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6563d-220f-477b-bf2f-a17e6816e170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:56.838300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6563d-220f-477b-bf2f-a17e6816e170 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:56.855148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 944/1880] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:38:56.898657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4b527673d44795b399f44e6447afb5', 'request_id': 'req-69edbca1-e02c-4541-bfd5-9c29361bea3d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.907490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4b527673d44795b399f44e6447afb5', 'request_id': 'req-69edbca1-e02c-4541-bfd5-9c29361bea3d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.926219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4b527673d44795b399f44e6447afb5', 'request_id': 'req-69edbca1-e02c-4541-bfd5-9c29361bea3d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.971710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] The token cache is being invalidate because project ac4b527673d44795b399f44e6447afb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:56.972036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.976375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:56.984331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 937/1881] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:56 2022] DELETE /identity/v3/projects/ac4b527673d44795b399f44e6447afb5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:56.991419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc1be9-f4bd-44f9-9560-c744fb11fe51 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:56.991714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc1be9-f4bd-44f9-9560-c744fb11fe51 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:56.991996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc1be9-f4bd-44f9-9560-c744fb11fe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.027707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-51cc1be9-f4bd-44f9-9560-c744fb11fe51 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:57.028980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-51cc1be9-f4bd-44f9-9560-c744fb11fe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:57.128649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.131496 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:57.157327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 945/1882] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:57.165764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d1122-c2a9-4070-9524-4ec8ad247c0a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.166071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d1122-c2a9-4070-9524-4ec8ad247c0a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.166332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d1122-c2a9-4070-9524-4ec8ad247c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.216338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-332d1122-c2a9-4070-9524-4ec8ad247c0a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:57.217570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-332d1122-c2a9-4070-9524-4ec8ad247c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:57.239926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 946/1883] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:57.245299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d1122-c2a9-4070-9524-4ec8ad247c0a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.265578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d1122-c2a9-4070-9524-4ec8ad247c0a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.274113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.274924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.275265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.276348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.277151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:57.277828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.278924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edbca1-e02c-4541-bfd5-9c29361bea3d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.279623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.284983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.286204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.286837 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.287290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] PATH_INFO: `/v3/projects/70439a89d6e14cae9365244e0eabe603` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.289236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70439a89d6e14cae9365244e0eabe603)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.292232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.302445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 947/1884] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:57.309306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.344580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068493-a34d-48f5-8d09-207f6b1c5728 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.356283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7f4fd-162c-481c-9253-028bee5cd585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.359402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f4fd-162c-481c-9253-028bee5cd585 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.359694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f4fd-162c-481c-9253-028bee5cd585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.359970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7f4fd-162c-481c-9253-028bee5cd585 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.360948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7f4fd-162c-481c-9253-028bee5cd585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.364952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7f4fd-162c-481c-9253-028bee5cd585 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.426558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 948/1885] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:57.427976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7f4fd-162c-481c-9253-028bee5cd585 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.429586 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70439a89d6e14cae9365244e0eabe603', 'request_id': 'req-7115a2bb-5384-44dc-a054-e31ba9170bd3'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:57.436163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70439a89d6e14cae9365244e0eabe603', 'request_id': 'req-7115a2bb-5384-44dc-a054-e31ba9170bd3'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:57.457805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70439a89d6e14cae9365244e0eabe603', 'request_id': 'req-7115a2bb-5384-44dc-a054-e31ba9170bd3'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:57.472810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] The token cache is being invalidate because project 70439a89d6e14cae9365244e0eabe603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:57.473149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:57.473908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7115a2bb-5384-44dc-a054-e31ba9170bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:57.476175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 938/1886] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:57 2022] DELETE /identity/v3/projects/70439a89d6e14cae9365244e0eabe603 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:57.481339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed964649-1f7e-4609-9471-de89952a3ebc None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.482745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed964649-1f7e-4609-9471-de89952a3ebc None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.485019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed964649-1f7e-4609-9471-de89952a3ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.511803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ed964649-1f7e-4609-9471-de89952a3ebc None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:57.513981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ed964649-1f7e-4609-9471-de89952a3ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:57.545105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7f4fd-162c-481c-9253-028bee5cd585 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.551566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.553082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.553082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.553323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.571974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.574046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.600368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 939/1887] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:57.603289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd790-cecf-4d23-a83a-467dbbbfcfad None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.603289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd790-cecf-4d23-a83a-467dbbbfcfad None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.603592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dd790-cecf-4d23-a83a-467dbbbfcfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.615527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 949/1888] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:57.619640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.621449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:57.639220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5d2dd790-cecf-4d23-a83a-467dbbbfcfad None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:57.640817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5d2dd790-cecf-4d23-a83a-467dbbbfcfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:57.647039 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b25d7-c6ad-4530-a90b-bbbae7ef645d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.675100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 940/1889] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:57.678432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac09f9-31ab-4b82-8333-8662f3140b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.678432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac09f9-31ab-4b82-8333-8662f3140b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.678432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac09f9-31ab-4b82-8333-8662f3140b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.678432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac09f9-31ab-4b82-8333-8662f3140b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.679197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac09f9-31ab-4b82-8333-8662f3140b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.679767 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dd790-cecf-4d23-a83a-467dbbbfcfad None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.680439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac09f9-31ab-4b82-8333-8662f3140b20 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.694259 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dd790-cecf-4d23-a83a-467dbbbfcfad None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.697420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 950/1890] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:57.705170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.705968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac09f9-31ab-4b82-8333-8662f3140b20 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.706091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.706475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.706879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.710595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:38:57.711480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.713518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.724650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac09f9-31ab-4b82-8333-8662f3140b20 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.735407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 941/1891] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:38:57.737850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.738473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb078-f28b-4c74-86e4-3088d710394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.741517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb078-f28b-4c74-86e4-3088d710394d admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.741847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb078-f28b-4c74-86e4-3088d710394d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.746229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cb078-f28b-4c74-86e4-3088d710394d admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.747046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb078-f28b-4c74-86e4-3088d710394d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.749088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cb078-f28b-4c74-86e4-3088d710394d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.762638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 951/1892] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:57.766894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb078-f28b-4c74-86e4-3088d710394d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.768976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab7805-faee-4778-a9fc-87a8211e20d2 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.777423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c87ef-c0c3-4aeb-9cda-e1b2d9151f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.777601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cb078-f28b-4c74-86e4-3088d710394d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.778132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c87ef-c0c3-4aeb-9cda-e1b2d9151f58 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.778415 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c87ef-c0c3-4aeb-9cda-e1b2d9151f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.779248 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c87ef-c0c3-4aeb-9cda-e1b2d9151f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.779940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c87ef-c0c3-4aeb-9cda-e1b2d9151f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.781873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c87ef-c0c3-4aeb-9cda-e1b2d9151f58 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.782819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9869-4412-4a03-95d2-85eca6cfed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.783890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9869-4412-4a03-95d2-85eca6cfed00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.784172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9869-4412-4a03-95d2-85eca6cfed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.784714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9869-4412-4a03-95d2-85eca6cfed00 admin admin] PATH_INFO: `/v3/projects/df7ad26e1846482f94a8017d8deb10de/users/5da3e6c7a0e144468b296a4f1ba74bfe/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.801848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e9869-4412-4a03-95d2-85eca6cfed00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7ad26e1846482f94a8017d8deb10de, user_id=5da3e6c7a0e144468b296a4f1ba74bfe, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.804937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e9869-4412-4a03-95d2-85eca6cfed00 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.811950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 942/1893] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:57.816002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c87ef-c0c3-4aeb-9cda-e1b2d9151f58 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.819375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 952/1894] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:57 2022] PUT /identity/v3/projects/df7ad26e1846482f94a8017d8deb10de/users/5da3e6c7a0e144468b296a4f1ba74bfe/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:57.830251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849825-a98b-4625-966d-a5af7f4ec24d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.830687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849825-a98b-4625-966d-a5af7f4ec24d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.830972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849825-a98b-4625-966d-a5af7f4ec24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.867818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b9849825-a98b-4625-966d-a5af7f4ec24d None None] MFA Rules not processed for user `5da3e6c7a0e144468b296a4f1ba74bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:57.869149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b9849825-a98b-4625-966d-a5af7f4ec24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:57.886563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c87ef-c0c3-4aeb-9cda-e1b2d9151f58 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.945866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.946539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.946848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.947120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.947806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.949172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 953/1895] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:38:57.953342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.954213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9849825-a98b-4625-966d-a5af7f4ec24d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.965166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9849825-a98b-4625-966d-a5af7f4ec24d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.971155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2fe68-9e59-430f-ab8a-94241b2c3c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:57.971990 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2fe68-9e59-430f-ab8a-94241b2c3c26 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:57.972339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2fe68-9e59-430f-ab8a-94241b2c3c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:57.972649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2fe68-9e59-430f-ab8a-94241b2c3c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:57.973592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2fe68-9e59-430f-ab8a-94241b2c3c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:57.975502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2fe68-9e59-430f-ab8a-94241b2c3c26 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:57.979595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 943/1896] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:38:57.980869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:57.982510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:57.994034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3300ed-5082-46dc-8b69-654c5bbb775d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:57.999322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.000241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.000537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.000819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] PATH_INFO: `/v3/users/7318e8deb8f64464b8ffa3217112acea` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.002067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7318e8deb8f64464b8ffa3217112acea)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.003994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.008183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 954/1897] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:57 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:38:58.009058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2fe68-9e59-430f-ab8a-94241b2c3c26 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.068106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7318e8deb8f64464b8ffa3217112acea'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.084434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7318e8deb8f64464b8ffa3217112acea'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.085121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7318e8deb8f64464b8ffa3217112acea'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.089734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2fe68-9e59-430f-ab8a-94241b2c3c26 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.093475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7318e8deb8f64464b8ffa3217112acea'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.094167 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7318e8deb8f64464b8ffa3217112acea'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.095384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069dae5-7fdd-4948-9786-9c8a9a8e0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.096152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069dae5-7fdd-4948-9786-9c8a9a8e0fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.096598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069dae5-7fdd-4948-9786-9c8a9a8e0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.096955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069dae5-7fdd-4948-9786-9c8a9a8e0fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.097827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069dae5-7fdd-4948-9786-9c8a9a8e0fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.099653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069dae5-7fdd-4948-9786-9c8a9a8e0fb2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.110396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 944/1898] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:57 2022] DELETE /identity/v3/users/7318e8deb8f64464b8ffa3217112acea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:58.111472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.113714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 955/1899] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:58.114429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:58.115079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99831cd4-3dad-4482-84aa-1dae405c83bc None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.115367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99831cd4-3dad-4482-84aa-1dae405c83bc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.116200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99831cd4-3dad-4482-84aa-1dae405c83bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.134270 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-99831cd4-3dad-4482-84aa-1dae405c83bc None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:58.135461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-99831cd4-3dad-4482-84aa-1dae405c83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:58.197378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef3216-d710-42f4-8b9a-8157833dbb40 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.204088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.205206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.205659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.206467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.207339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.209048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.209704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 956/1900] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:58.211440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99831cd4-3dad-4482-84aa-1dae405c83bc None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.214003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-99831cd4-3dad-4482-84aa-1dae405c83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:58.229232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99831cd4-3dad-4482-84aa-1dae405c83bc None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.231600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 945/1901] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:58 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:58.232580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.235373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:58.237770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6f9c3-9f34-4a27-85da-7ea144194ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.238672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f9c3-9f34-4a27-85da-7ea144194ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.239626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f9c3-9f34-4a27-85da-7ea144194ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.240095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f9c3-9f34-4a27-85da-7ea144194ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.240998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6f9c3-9f34-4a27-85da-7ea144194ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.242806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6f9c3-9f34-4a27-85da-7ea144194ea4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.255992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 957/1902] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:58.257096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6f9c3-9f34-4a27-85da-7ea144194ea4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.269655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6f9c3-9f34-4a27-85da-7ea144194ea4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.276963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034801d7-00d9-4329-bd65-27235e9c1846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.278682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034801d7-00d9-4329-bd65-27235e9c1846 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.278915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034801d7-00d9-4329-bd65-27235e9c1846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.279186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034801d7-00d9-4329-bd65-27235e9c1846 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.279912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034801d7-00d9-4329-bd65-27235e9c1846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.289979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034801d7-00d9-4329-bd65-27235e9c1846 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.310433 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 958/1903] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:58.310433 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034801d7-00d9-4329-bd65-27235e9c1846 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.327002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006c319-bece-4c4c-98ab-a17a9be87c3e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.330438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034801d7-00d9-4329-bd65-27235e9c1846 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.331632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fea0-13ac-4e32-a188-b4bece51385e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.332467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fea0-13ac-4e32-a188-b4bece51385e service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.333089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fea0-13ac-4e32-a188-b4bece51385e service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.333370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fea0-13ac-4e32-a188-b4bece51385e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.335757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209259f-8541-4b92-b86b-0fce60ce2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.336642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209259f-8541-4b92-b86b-0fce60ce2fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.336923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209259f-8541-4b92-b86b-0fce60ce2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.337194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209259f-8541-4b92-b86b-0fce60ce2fbb admin admin] PATH_INFO: `/v3/projects/6a68c9cdad124fc2881ea85d32ed7a91/users/0ce556b161e34ac2af03dd64ec8b5d1a/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.342567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3fea0-13ac-4e32-a188-b4bece51385e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.344073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3fea0-13ac-4e32-a188-b4bece51385e service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.354137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 946/1904] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:58.354756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fea0-13ac-4e32-a188-b4bece51385e service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.356595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209259f-8541-4b92-b86b-0fce60ce2fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a68c9cdad124fc2881ea85d32ed7a91, user_id=0ce556b161e34ac2af03dd64ec8b5d1a, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.359791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209259f-8541-4b92-b86b-0fce60ce2fbb admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.364939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fea0-13ac-4e32-a188-b4bece51385e service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.370998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdaa7f-687d-4f83-bc1b-c0839249a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.372215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdaa7f-687d-4f83-bc1b-c0839249a426 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.373214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdaa7f-687d-4f83-bc1b-c0839249a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.373512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdaa7f-687d-4f83-bc1b-c0839249a426 admin admin] PATH_INFO: `/v3/projects/34a355b3223247a48c4be3200ce381c0/users/bd66fbf272134bf9b9f328e16f2cb458/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.386586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 959/1905] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:58 2022] PUT /identity/v3/projects/6a68c9cdad124fc2881ea85d32ed7a91/users/0ce556b161e34ac2af03dd64ec8b5d1a/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:58.389876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdaa7f-687d-4f83-bc1b-c0839249a426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a355b3223247a48c4be3200ce381c0, user_id=bd66fbf272134bf9b9f328e16f2cb458, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.390017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be93f5e-ee42-44f7-b07c-a3a86f2fd46f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.392591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdaa7f-687d-4f83-bc1b-c0839249a426 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.393734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be93f5e-ee42-44f7-b07c-a3a86f2fd46f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.394031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be93f5e-ee42-44f7-b07c-a3a86f2fd46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.414366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 947/1906] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:58 2022] PUT /identity/v3/projects/34a355b3223247a48c4be3200ce381c0/users/bd66fbf272134bf9b9f328e16f2cb458/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:58.422802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdaa7f-687d-4f83-bc1b-c0839249a426 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.448036 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8be93f5e-ee42-44f7-b07c-a3a86f2fd46f None None] MFA Rules not processed for user `0ce556b161e34ac2af03dd64ec8b5d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:58.453289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8be93f5e-ee42-44f7-b07c-a3a86f2fd46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:58.540676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdaa7f-687d-4f83-bc1b-c0839249a426 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.547711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e942ac-d61c-40bd-8fa5-fdaacf054fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.548346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e942ac-d61c-40bd-8fa5-fdaacf054fca admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.548705 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e942ac-d61c-40bd-8fa5-fdaacf054fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.549102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e942ac-d61c-40bd-8fa5-fdaacf054fca admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.549944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e942ac-d61c-40bd-8fa5-fdaacf054fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.564798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e942ac-d61c-40bd-8fa5-fdaacf054fca admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.584627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 948/1907] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:58.589406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e942ac-d61c-40bd-8fa5-fdaacf054fca admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.609853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e942ac-d61c-40bd-8fa5-fdaacf054fca admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.617640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 960/1908] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:58.620968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be93f5e-ee42-44f7-b07c-a3a86f2fd46f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.623529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b92485-3875-4953-8bb7-196d3658667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.624524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92485-3875-4953-8bb7-196d3658667c admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.624873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92485-3875-4953-8bb7-196d3658667c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.625208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92485-3875-4953-8bb7-196d3658667c admin admin] PATH_INFO: `/v3/projects/34a355b3223247a48c4be3200ce381c0/users/bd66fbf272134bf9b9f328e16f2cb458/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.627450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b92485-3875-4953-8bb7-196d3658667c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a355b3223247a48c4be3200ce381c0, user_id=bd66fbf272134bf9b9f328e16f2cb458, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.630734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b92485-3875-4953-8bb7-196d3658667c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.635385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be93f5e-ee42-44f7-b07c-a3a86f2fd46f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.641144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246555-ad4e-4eb1-8877-162e48fa453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.641937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246555-ad4e-4eb1-8877-162e48fa453e admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.642287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246555-ad4e-4eb1-8877-162e48fa453e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.642629 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246555-ad4e-4eb1-8877-162e48fa453e admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.645743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6246555-ad4e-4eb1-8877-162e48fa453e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.646902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 949/1909] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:58 2022] PUT /identity/v3/projects/34a355b3223247a48c4be3200ce381c0/users/bd66fbf272134bf9b9f328e16f2cb458/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:58.649592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6246555-ad4e-4eb1-8877-162e48fa453e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.657461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070d87-15f2-4f2f-824f-c8a158eb648b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.657789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070d87-15f2-4f2f-824f-c8a158eb648b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.658142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070d87-15f2-4f2f-824f-c8a158eb648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.686985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2e070d87-15f2-4f2f-824f-c8a158eb648b None None] MFA Rules not processed for user `bd66fbf272134bf9b9f328e16f2cb458`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:58.687895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 961/1910] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:38:58 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:58.688785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246555-ad4e-4eb1-8877-162e48fa453e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.688915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2e070d87-15f2-4f2f-824f-c8a158eb648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:58.781442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 950/1911] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:58.782536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070d87-15f2-4f2f-824f-c8a158eb648b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.784272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2e070d87-15f2-4f2f-824f-c8a158eb648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:58.788387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246555-ad4e-4eb1-8877-162e48fa453e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.795877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5474f8c-d19d-410c-8743-1ae2c32aa882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.796573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5474f8c-d19d-410c-8743-1ae2c32aa882 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.796854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5474f8c-d19d-410c-8743-1ae2c32aa882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.797130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5474f8c-d19d-410c-8743-1ae2c32aa882 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.797855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5474f8c-d19d-410c-8743-1ae2c32aa882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.800189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5474f8c-d19d-410c-8743-1ae2c32aa882 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.801038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070d87-15f2-4f2f-824f-c8a158eb648b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.813447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.814477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.814857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.815252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] PATH_INFO: `/v3/projects/70dc2c13c9134d1b9f3567701b8be129` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.817112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70dc2c13c9134d1b9f3567701b8be129)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.820856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.832181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 962/1912] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:38:58 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:38:58.836967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5474f8c-d19d-410c-8743-1ae2c32aa882 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.854305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5474f8c-d19d-410c-8743-1ae2c32aa882 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.863995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3c3d0-f7ee-418f-b280-8559a8ae4805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.865161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c3d0-f7ee-418f-b280-8559a8ae4805 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.865741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c3d0-f7ee-418f-b280-8559a8ae4805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.866258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3c3d0-f7ee-418f-b280-8559a8ae4805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.867289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3c3d0-f7ee-418f-b280-8559a8ae4805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:58.869331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb3c3d0-f7ee-418f-b280-8559a8ae4805 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:58.883142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 963/1913] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:58.889051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3c3d0-f7ee-418f-b280-8559a8ae4805 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:58.904740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3c3d0-f7ee-418f-b280-8559a8ae4805 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:58.929771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70dc2c13c9134d1b9f3567701b8be129', 'request_id': 'req-b308b7a4-5851-4d20-812c-e081f17b9ed8'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.951994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70dc2c13c9134d1b9f3567701b8be129', 'request_id': 'req-b308b7a4-5851-4d20-812c-e081f17b9ed8'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.973232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70dc2c13c9134d1b9f3567701b8be129', 'request_id': 'req-b308b7a4-5851-4d20-812c-e081f17b9ed8'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.989755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:58.991044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:58.991456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:58.991836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] PATH_INFO: `/v3/projects/39026a98e0854af0b5c1915f66ea344d/users/b6ed9d9655e84e42b851bf935f200a23/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:58.992741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] The token cache is being invalidate because project 70dc2c13c9134d1b9f3567701b8be129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:38:58.993371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.994245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:58.996176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 951/1914] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:58 2022] DELETE /identity/v3/projects/70dc2c13c9134d1b9f3567701b8be129 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:59.000895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:59.003495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.013888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39026a98e0854af0b5c1915f66ea344d, user_id=b6ed9d9655e84e42b851bf935f200a23, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:59.017340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:59.019612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308b7a4-5851-4d20-812c-e081f17b9ed8 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:59.026107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:59.027433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:59.027753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:59.028002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] PATH_INFO: `/v3/users/c59a08b11301416cbc04dffc46f4b4dd` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:59.029339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59a08b11301416cbc04dffc46f4b4dd)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:59.031245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:59.047854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 964/1915] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:58 2022] PUT /identity/v3/projects/39026a98e0854af0b5c1915f66ea344d/users/b6ed9d9655e84e42b851bf935f200a23/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:59.049159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:59.052527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.094034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59a08b11301416cbc04dffc46f4b4dd'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:59.114068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59a08b11301416cbc04dffc46f4b4dd'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:59.114936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59a08b11301416cbc04dffc46f4b4dd'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:59.123583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59a08b11301416cbc04dffc46f4b4dd'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:59.124334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59a08b11301416cbc04dffc46f4b4dd'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:59.152385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 952/1916] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:38:59 2022] DELETE /identity/v3/users/c59a08b11301416cbc04dffc46f4b4dd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:38:59.152385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:59.167292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.178516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a00aec-a30e-4608-9809-4e1aa52c96b3 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:59.291989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8191b1-43b8-45a3-b95f-be43ea33fbae admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:59.301769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c94f28-a9cd-47b9-9dc0-52e0c68f7387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:59.302381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c94f28-a9cd-47b9-9dc0-52e0c68f7387 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:59.302685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c94f28-a9cd-47b9-9dc0-52e0c68f7387 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:59.302963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c94f28-a9cd-47b9-9dc0-52e0c68f7387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:59.309521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-35c94f28-a9cd-47b9-9dc0-52e0c68f7387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.344836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:59.345593 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:59.345894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:59.346178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:59.349835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:59.351693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:59.378321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 965/1917] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:38:59.383303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:59.390205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.440644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c94f28-a9cd-47b9-9dc0-52e0c68f7387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:59.441518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98820-0207-4ffc-82d5-c9e3575942c0 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:59.443136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c94f28-a9cd-47b9-9dc0-52e0c68f7387 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:59.469918 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 953/1918] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:38:59.489322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:59.495062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:59.495337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:59.502663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] PATH_INFO: `/v3/projects/39026a98e0854af0b5c1915f66ea344d/users/b6ed9d9655e84e42b851bf935f200a23/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:59.514038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39026a98e0854af0b5c1915f66ea344d, user_id=b6ed9d9655e84e42b851bf935f200a23, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:59.521530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:59.566436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 966/1919] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:38:59 2022] PUT /identity/v3/projects/39026a98e0854af0b5c1915f66ea344d/users/b6ed9d9655e84e42b851bf935f200a23/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:38:59.569369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3dc41-7c5f-4e0f-9835-39c65075ea79 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:59.569731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3dc41-7c5f-4e0f-9835-39c65075ea79 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:59.570010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3dc41-7c5f-4e0f-9835-39c65075ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:59.645031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:59.647253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.659989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2ed3dc41-7c5f-4e0f-9835-39c65075ea79 None None] MFA Rules not processed for user `b6ed9d9655e84e42b851bf935f200a23`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:38:59.661686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2ed3dc41-7c5f-4e0f-9835-39c65075ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.770731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 954/1920] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:38:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:38:59.775137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3dc41-7c5f-4e0f-9835-39c65075ea79 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:59.775137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2ed3dc41-7c5f-4e0f-9835-39c65075ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.803944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330139-af80-42eb-95b6-2a5521e1eb3e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:59.808184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:59.808936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:59.809301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:59.809675 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:59.811603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:38:59.889509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3dc41-7c5f-4e0f-9835-39c65075ea79 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:59.894756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:59.895394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:59.895629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:59.895912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:59.896183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] PATH_INFO: `/v3/projects/a19ec05974e342e88ecf333714bc5389` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:59.897063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:59.897474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19ec05974e342e88ecf333714bc5389)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:59.899417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:59.907285 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 967/1921] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:38:59.908127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:38:59.922563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421359-197a-474d-a9ef-e9dbacf48218 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:38:59.936175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119872d-0bf4-4c92-9e0c-f63521333885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:38:59.936856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119872d-0bf4-4c92-9e0c-f63521333885 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:38:59.937148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119872d-0bf4-4c92-9e0c-f63521333885 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:38:59.939249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119872d-0bf4-4c92-9e0c-f63521333885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:38:59.969092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119872d-0bf4-4c92-9e0c-f63521333885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:38:59.971930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119872d-0bf4-4c92-9e0c-f63521333885 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:38:59.984966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19ec05974e342e88ecf333714bc5389', 'request_id': 'req-fe9ce6d7-1c0b-4367-8532-2842160d3119'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:38:59.993561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 968/1922] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:38:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:00.002602 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19ec05974e342e88ecf333714bc5389', 'request_id': 'req-fe9ce6d7-1c0b-4367-8532-2842160d3119'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:00.019143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19ec05974e342e88ecf333714bc5389', 'request_id': 'req-fe9ce6d7-1c0b-4367-8532-2842160d3119'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:00.039051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] The token cache is being invalidate because project a19ec05974e342e88ecf333714bc5389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:00.039587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:00.042756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:00.046713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 955/1923] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:38:59 2022] DELETE /identity/v3/projects/a19ec05974e342e88ecf333714bc5389 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:00.052206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec25099-8275-4f74-a3fb-a402cb492fc1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.052501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec25099-8275-4f74-a3fb-a402cb492fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.052781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec25099-8275-4f74-a3fb-a402cb492fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.093483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:00.095956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:00.120424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1ec25099-8275-4f74-a3fb-a402cb492fc1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:00.123029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1ec25099-8275-4f74-a3fb-a402cb492fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:00.207094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 969/1924] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:00.224796 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddd9e1-7bab-4ce5-a1a7-dcd402dffa6a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.225091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddd9e1-7bab-4ce5-a1a7-dcd402dffa6a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.225375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddd9e1-7bab-4ce5-a1a7-dcd402dffa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.235679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ce6d7-1c0b-4367-8532-2842160d3119 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:00.241302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:00.242303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.242722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.243014 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.244962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:00.276451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-82ddd9e1-7bab-4ce5-a1a7-dcd402dffa6a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:00.282754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-82ddd9e1-7bab-4ce5-a1a7-dcd402dffa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:00.300552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 970/1925] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:00.305038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddd9e1-7bab-4ce5-a1a7-dcd402dffa6a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:00.320371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddd9e1-7bab-4ce5-a1a7-dcd402dffa6a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:00.336286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:00.337181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.337828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.338385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.339337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:00.339650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:00.342259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:00.356783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:00.359430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:00.360054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 971/1926] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:39:00.365450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:00.374746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 956/1927] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:00.386846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a317b-08ba-4fb0-8313-ca340230bd9c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:00.400180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e98ae5-c997-454d-9d9f-cba9ee541a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:00.400927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98ae5-c997-454d-9d9f-cba9ee541a18 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.401285 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98ae5-c997-454d-9d9f-cba9ee541a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.401670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98ae5-c997-454d-9d9f-cba9ee541a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.402443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e98ae5-c997-454d-9d9f-cba9ee541a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:00.404627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e98ae5-c997-454d-9d9f-cba9ee541a18 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:00.432511 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 972/1928] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:00 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:00.437232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:00.448850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ace3-36b7-4e69-b05f-7e489ab2c1b9 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:00.519515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4441f-995f-451d-8e90-f91c38ba6887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:00.520301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4441f-995f-451d-8e90-f91c38ba6887 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.520678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4441f-995f-451d-8e90-f91c38ba6887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.521029 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4441f-995f-451d-8e90-f91c38ba6887 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.521842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4441f-995f-451d-8e90-f91c38ba6887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:00.524001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4441f-995f-451d-8e90-f91c38ba6887 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:00.552404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 957/1929] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:00 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:00.556810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e98ae5-c997-454d-9d9f-cba9ee541a18 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:00.569994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e98ae5-c997-454d-9d9f-cba9ee541a18 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:00.576978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc58b4-2687-45d8-9744-5653bbaa6339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:00.577679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc58b4-2687-45d8-9744-5653bbaa6339 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.577958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc58b4-2687-45d8-9744-5653bbaa6339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.578231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc58b4-2687-45d8-9744-5653bbaa6339 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.578951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc58b4-2687-45d8-9744-5653bbaa6339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:00.580555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc58b4-2687-45d8-9744-5653bbaa6339 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:00.592550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 973/1930] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:00.596796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4441f-995f-451d-8e90-f91c38ba6887 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:00.607784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4441f-995f-451d-8e90-f91c38ba6887 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:00.613836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65901-8ace-4815-8a25-63b843dc5b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:00.615145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65901-8ace-4815-8a25-63b843dc5b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.615145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65901-8ace-4815-8a25-63b843dc5b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.615145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65901-8ace-4815-8a25-63b843dc5b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.615953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65901-8ace-4815-8a25-63b843dc5b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:00.617714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65901-8ace-4815-8a25-63b843dc5b45 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:00.629808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 958/1931] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:00.633972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc58b4-2687-45d8-9744-5653bbaa6339 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:00.659799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc58b4-2687-45d8-9744-5653bbaa6339 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:00.669577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052e842-e926-466c-96b0-4b12690e6c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:00.670669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052e842-e926-466c-96b0-4b12690e6c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.671073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052e842-e926-466c-96b0-4b12690e6c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.671352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052e842-e926-466c-96b0-4b12690e6c7a admin admin] PATH_INFO: `/v3/projects/b5c28acf484b423bbdfa362d5e288615/users/fc72e8015d614d6b9c18de4267708353/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.692401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052e842-e926-466c-96b0-4b12690e6c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c28acf484b423bbdfa362d5e288615, user_id=fc72e8015d614d6b9c18de4267708353, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:00.695197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052e842-e926-466c-96b0-4b12690e6c7a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:00.722190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 974/1932] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:00 2022] PUT /identity/v3/projects/b5c28acf484b423bbdfa362d5e288615/users/fc72e8015d614d6b9c18de4267708353/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:00.734565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870c46-558a-4082-ab5d-9978901a1adb None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:00.735160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870c46-558a-4082-ab5d-9978901a1adb None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:00.736287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a870c46-558a-4082-ab5d-9978901a1adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:00.780052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1a870c46-558a-4082-ab5d-9978901a1adb None None] MFA Rules not processed for user `fc72e8015d614d6b9c18de4267708353`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:00.782674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1a870c46-558a-4082-ab5d-9978901a1adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:00.962659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 959/1933] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:00.967694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052e842-e926-466c-96b0-4b12690e6c7a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:01.040955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052e842-e926-466c-96b0-4b12690e6c7a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:01.050152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd779b2-b893-4264-9868-57f7249767dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:01.051613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd779b2-b893-4264-9868-57f7249767dc admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:01.052097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd779b2-b893-4264-9868-57f7249767dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:01.052580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd779b2-b893-4264-9868-57f7249767dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:01.053490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd779b2-b893-4264-9868-57f7249767dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:01.055740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd779b2-b893-4264-9868-57f7249767dc admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:01.121460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 975/1934] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:00 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:01.124537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a870c46-558a-4082-ab5d-9978901a1adb None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:01.144600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a870c46-558a-4082-ab5d-9978901a1adb None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:01.223853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a3789-83bd-4b04-a6f3-4ba64bd9f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:01.224863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a3789-83bd-4b04-a6f3-4ba64bd9f139 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:01.226313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a3789-83bd-4b04-a6f3-4ba64bd9f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:01.226850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a3789-83bd-4b04-a6f3-4ba64bd9f139 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:01.227909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a3789-83bd-4b04-a6f3-4ba64bd9f139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:01.230811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a3789-83bd-4b04-a6f3-4ba64bd9f139 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:01.256533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 960/1935] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:01 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:01.260749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd779b2-b893-4264-9868-57f7249767dc admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:01.292196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd779b2-b893-4264-9868-57f7249767dc admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:01.299384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8908c-ddcf-4941-bf98-dfcc7a2dbcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:01.302082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8908c-ddcf-4941-bf98-dfcc7a2dbcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:01.303885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8908c-ddcf-4941-bf98-dfcc7a2dbcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:01.304271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8908c-ddcf-4941-bf98-dfcc7a2dbcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:01.307591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8908c-ddcf-4941-bf98-dfcc7a2dbcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:01.309256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b8908c-ddcf-4941-bf98-dfcc7a2dbcc7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:01.324289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 976/1936] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:01.329778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a3789-83bd-4b04-a6f3-4ba64bd9f139 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:01.342972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a3789-83bd-4b04-a6f3-4ba64bd9f139 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:01.348713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb2ec-7707-4b42-9050-4223dc759e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:01.350006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb2ec-7707-4b42-9050-4223dc759e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:01.350267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb2ec-7707-4b42-9050-4223dc759e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:01.350991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb2ec-7707-4b42-9050-4223dc759e4d admin admin] PATH_INFO: `/v3/projects/60fc73e2f37c484d8b78c0976223c899/users/5c953b41ebcf457baa2ed741d92f3dde/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:01.369800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb2ec-7707-4b42-9050-4223dc759e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fc73e2f37c484d8b78c0976223c899, user_id=5c953b41ebcf457baa2ed741d92f3dde, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:01.373782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb2ec-7707-4b42-9050-4223dc759e4d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:01.395136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 961/1937] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:01 2022] PUT /identity/v3/projects/60fc73e2f37c484d8b78c0976223c899/users/5c953b41ebcf457baa2ed741d92f3dde/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:01.396253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8908c-ddcf-4941-bf98-dfcc7a2dbcc7 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:01.409516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8908c-ddcf-4941-bf98-dfcc7a2dbcc7 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:01.574563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0086d6-a578-4f7c-b03b-989178060fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:01.576248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0086d6-a578-4f7c-b03b-989178060fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:01.576667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0086d6-a578-4f7c-b03b-989178060fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:01.577119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0086d6-a578-4f7c-b03b-989178060fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:01.578621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0086d6-a578-4f7c-b03b-989178060fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:01.580537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0086d6-a578-4f7c-b03b-989178060fa1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:01.603199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 977/1938] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:01.607221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb2ec-7707-4b42-9050-4223dc759e4d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:01.618031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb2ec-7707-4b42-9050-4223dc759e4d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:01.638709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:01.639688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:01.640168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:01.640507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] PATH_INFO: `/v3/projects/60fc73e2f37c484d8b78c0976223c899/users/5c953b41ebcf457baa2ed741d92f3dde/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:01.642624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fc73e2f37c484d8b78c0976223c899, user_id=5c953b41ebcf457baa2ed741d92f3dde, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:01.646433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:01.668814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 962/1939] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:01 2022] PUT /identity/v3/projects/60fc73e2f37c484d8b78c0976223c899/users/5c953b41ebcf457baa2ed741d92f3dde/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:01.680096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd1e2-f5c0-4e82-ab99-19654dd1cda4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:01.680449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd1e2-f5c0-4e82-ab99-19654dd1cda4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:01.680753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd1e2-f5c0-4e82-ab99-19654dd1cda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:01.721532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6defd1e2-f5c0-4e82-ab99-19654dd1cda4 None None] MFA Rules not processed for user `5c953b41ebcf457baa2ed741d92f3dde`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:01.723765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6defd1e2-f5c0-4e82-ab99-19654dd1cda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:01.808421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 978/1940] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:01.820332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:01.822401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:01.941030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ae1bd-95d4-40c0-b684-2a91962e19e9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:01.946323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59c60c-c2aa-426d-b974-611aecc529a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:01.947330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c60c-c2aa-426d-b974-611aecc529a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:01.947783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c60c-c2aa-426d-b974-611aecc529a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:01.948153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c60c-c2aa-426d-b974-611aecc529a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:01.962576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59c60c-c2aa-426d-b974-611aecc529a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:01.964131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59c60c-c2aa-426d-b974-611aecc529a6 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:01.989708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 963/1941] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:02.230906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd1e2-f5c0-4e82-ab99-19654dd1cda4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:02.233697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6defd1e2-f5c0-4e82-ab99-19654dd1cda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:02.322046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd1e2-f5c0-4e82-ab99-19654dd1cda4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:02.326841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:02.327806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:02.328207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:02.328567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] PATH_INFO: `/v3/users/c0aedd5d711b4f59948e601e64aad323` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:02.329963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0aedd5d711b4f59948e601e64aad323)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:02.331958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:02.386071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0aedd5d711b4f59948e601e64aad323'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.400375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0aedd5d711b4f59948e601e64aad323'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.414554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0aedd5d711b4f59948e601e64aad323'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.415263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0aedd5d711b4f59948e601e64aad323'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.427031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0aedd5d711b4f59948e601e64aad323'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.435675 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 979/1942] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:02 2022] DELETE /identity/v3/users/c0aedd5d711b4f59948e601e64aad323 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:02.440258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d30b6-59da-4dc0-ba02-e316f47e702b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:02.440706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d30b6-59da-4dc0-ba02-e316f47e702b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:02.440832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d30b6-59da-4dc0-ba02-e316f47e702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:02.460838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-070d30b6-59da-4dc0-ba02-e316f47e702b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:02.462184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-070d30b6-59da-4dc0-ba02-e316f47e702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:02.572724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 964/1943] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:02.580978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:02.583064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:02.699130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620fd66-fad4-4e8d-a2b6-71a76b20ca1a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:02.702893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6667d-7651-4dc9-8f53-dd919fe82e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:02.703542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6667d-7651-4dc9-8f53-dd919fe82e94 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:02.703893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6667d-7651-4dc9-8f53-dd919fe82e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:02.704175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6667d-7651-4dc9-8f53-dd919fe82e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:02.723866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6667d-7651-4dc9-8f53-dd919fe82e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:02.725232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6667d-7651-4dc9-8f53-dd919fe82e94 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:02.738003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 980/1944] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:02.840229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d30b6-59da-4dc0-ba02-e316f47e702b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:02.842556 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-070d30b6-59da-4dc0-ba02-e316f47e702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:02.854950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d30b6-59da-4dc0-ba02-e316f47e702b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:02.864152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:02.865045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:02.865333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:02.865642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] PATH_INFO: `/v3/users/fc72e8015d614d6b9c18de4267708353` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:02.866858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc72e8015d614d6b9c18de4267708353)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:02.868791 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:02.915260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc72e8015d614d6b9c18de4267708353'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.928900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc72e8015d614d6b9c18de4267708353'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.929838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc72e8015d614d6b9c18de4267708353'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.948738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc72e8015d614d6b9c18de4267708353'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.949640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc72e8015d614d6b9c18de4267708353'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:02.970806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 965/1945] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:02 2022] DELETE /identity/v3/users/fc72e8015d614d6b9c18de4267708353 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:02.976949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ce0a2-4d72-4de9-890a-42bdca89058f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:02.977250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ce0a2-4d72-4de9-890a-42bdca89058f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:02.977652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ce0a2-4d72-4de9-890a-42bdca89058f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:02.997553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-465ce0a2-4d72-4de9-890a-42bdca89058f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:02.998791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-465ce0a2-4d72-4de9-890a-42bdca89058f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:03.072919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 981/1946] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:03.083426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:03.084865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:03.154493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6662e3-40a6-446f-8166-da1837f8cc06 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:03.162276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf9f32-a872-4b61-a71e-f9801fa2cca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:03.163432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf9f32-a872-4b61-a71e-f9801fa2cca5 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:03.163989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf9f32-a872-4b61-a71e-f9801fa2cca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:03.164572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf9f32-a872-4b61-a71e-f9801fa2cca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:03.180147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf9f32-a872-4b61-a71e-f9801fa2cca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:03.185182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf9f32-a872-4b61-a71e-f9801fa2cca5 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:03.202051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ce0a2-4d72-4de9-890a-42bdca89058f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:03.205357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-465ce0a2-4d72-4de9-890a-42bdca89058f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:03.212258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 966/1947] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:03.231215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ce0a2-4d72-4de9-890a-42bdca89058f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:03.237770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:03.238840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:03.239275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:03.239596 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] PATH_INFO: `/v3/projects/7a507bbecfc149f6987ac7b881b0b1b3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:03.240980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a507bbecfc149f6987ac7b881b0b1b3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:03.244564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:03.304642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a507bbecfc149f6987ac7b881b0b1b3', 'request_id': 'req-a9099434-ae34-4973-89cf-fc82f71e02ef'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.311078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a507bbecfc149f6987ac7b881b0b1b3', 'request_id': 'req-a9099434-ae34-4973-89cf-fc82f71e02ef'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.319698 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a507bbecfc149f6987ac7b881b0b1b3', 'request_id': 'req-a9099434-ae34-4973-89cf-fc82f71e02ef'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.331673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] The token cache is being invalidate because project 7a507bbecfc149f6987ac7b881b0b1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:03.331890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.332537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.337177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 982/1948] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:03 2022] DELETE /identity/v3/projects/7a507bbecfc149f6987ac7b881b0b1b3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:03.338523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf9f32-a872-4b61-a71e-f9801fa2cca5 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:03.349871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf9f32-a872-4b61-a71e-f9801fa2cca5 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:03.408966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:03.410085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:03.410665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:03.410962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] PATH_INFO: `/v3/users/8906e52a21c04fc1a146bc87c12408c6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:03.412245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8906e52a21c04fc1a146bc87c12408c6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:03.414475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:03.489504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8906e52a21c04fc1a146bc87c12408c6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.507677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8906e52a21c04fc1a146bc87c12408c6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.508479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8906e52a21c04fc1a146bc87c12408c6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.517376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8906e52a21c04fc1a146bc87c12408c6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.518499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8906e52a21c04fc1a146bc87c12408c6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.535596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 967/1949] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:03 2022] DELETE /identity/v3/users/8906e52a21c04fc1a146bc87c12408c6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:03.584196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:03.585582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:03.597899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9099434-ae34-4973-89cf-fc82f71e02ef admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:03.686040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:03.687544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:03.687858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:03.688113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] PATH_INFO: `/v3/projects/b5c28acf484b423bbdfa362d5e288615` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:03.690080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c28acf484b423bbdfa362d5e288615)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:03.693357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:03.763588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c28acf484b423bbdfa362d5e288615', 'request_id': 'req-1b29a97c-8142-4105-b990-44a3046792c3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.768962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c28acf484b423bbdfa362d5e288615', 'request_id': 'req-1b29a97c-8142-4105-b990-44a3046792c3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.778160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c28acf484b423bbdfa362d5e288615', 'request_id': 'req-1b29a97c-8142-4105-b990-44a3046792c3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.797847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] The token cache is being invalidate because project b5c28acf484b423bbdfa362d5e288615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:03.798779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.799627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:03.802244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 983/1950] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:03 2022] DELETE /identity/v3/projects/b5c28acf484b423bbdfa362d5e288615 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:03.805936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:03.807487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:03.822655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816f46-734e-4a5a-b5e6-53e4c078a4fa admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:03.883116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:03.885220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:03.894481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:03.895882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:03.896314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:03.896769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] PATH_INFO: `/v3/users/5c953b41ebcf457baa2ed741d92f3dde` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:03.898174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c953b41ebcf457baa2ed741d92f3dde)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:03.900338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:03.986528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29a97c-8142-4105-b990-44a3046792c3 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:03.995934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:03.998198 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:03.999653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.000337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] PATH_INFO: `/v3/projects/e3e4087f0c4d40d8b2bfe21c0a00a8cd` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.002033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e4087f0c4d40d8b2bfe21c0a00a8cd)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.004806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.006149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c953b41ebcf457baa2ed741d92f3dde'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.028006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c953b41ebcf457baa2ed741d92f3dde'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.037486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c953b41ebcf457baa2ed741d92f3dde'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.058047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c953b41ebcf457baa2ed741d92f3dde'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.059208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fd96b26b-688c-45c3-890a-700050338d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c953b41ebcf457baa2ed741d92f3dde'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.064328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e4087f0c4d40d8b2bfe21c0a00a8cd', 'request_id': 'req-37d4dde1-ad8e-43b0-a851-6c8068b829c7'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.072777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e4087f0c4d40d8b2bfe21c0a00a8cd', 'request_id': 'req-37d4dde1-ad8e-43b0-a851-6c8068b829c7'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.081822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 968/1951] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:03 2022] DELETE /identity/v3/users/5c953b41ebcf457baa2ed741d92f3dde => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:04.090066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e4087f0c4d40d8b2bfe21c0a00a8cd', 'request_id': 'req-37d4dde1-ad8e-43b0-a851-6c8068b829c7'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.104830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] The token cache is being invalidate because project e3e4087f0c4d40d8b2bfe21c0a00a8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:04.105344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.106232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-37d4dde1-ad8e-43b0-a851-6c8068b829c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.108909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 984/1952] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:03 2022] DELETE /identity/v3/projects/e3e4087f0c4d40d8b2bfe21c0a00a8cd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:04.113462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53cc4-2bcb-411d-a705-b8c49cc8ac33 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.113786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53cc4-2bcb-411d-a705-b8c49cc8ac33 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.114074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae53cc4-2bcb-411d-a705-b8c49cc8ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.139071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1ae53cc4-2bcb-411d-a705-b8c49cc8ac33 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:04.140769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1ae53cc4-2bcb-411d-a705-b8c49cc8ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.230290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 969/1953] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:04.238281 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c7d22-1152-49f2-a7c7-01ed6a325013 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.238778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c7d22-1152-49f2-a7c7-01ed6a325013 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.238926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c7d22-1152-49f2-a7c7-01ed6a325013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.268149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-089c7d22-1152-49f2-a7c7-01ed6a325013 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:04.269922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-089c7d22-1152-49f2-a7c7-01ed6a325013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.280556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 985/1954] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:04.285831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae53cc4-2bcb-411d-a705-b8c49cc8ac33 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.299720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae53cc4-2bcb-411d-a705-b8c49cc8ac33 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.307807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.308681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.309046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.309522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.310534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:04.310974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.312636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.326285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 970/1955] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:04.330860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c7d22-1152-49f2-a7c7-01ed6a325013 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.343312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c7d22-1152-49f2-a7c7-01ed6a325013 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.348262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.348994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.349344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.349734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.350589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.352537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.381594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 986/1956] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:04.385852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.399113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6d938-5d2f-4d45-83ca-9d74a881ff41 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.403844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.405921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.472721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.473402 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.475094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.475094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.475094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.477256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.478601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0146e-5827-4bda-b78b-4bb89cac091e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.493725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.494893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.495252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.495596 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] PATH_INFO: `/v3/users/0ce556b161e34ac2af03dd64ec8b5d1a` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.496939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce556b161e34ac2af03dd64ec8b5d1a)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.499269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.505789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 971/1957] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:04.505789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.505789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.519694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268e046-9083-4053-896e-b0e88bd098ec admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.524714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.525675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.525962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.526239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] PATH_INFO: `/v3/projects/60fc73e2f37c484d8b78c0976223c899` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.527450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fc73e2f37c484d8b78c0976223c899)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.530341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.555053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce556b161e34ac2af03dd64ec8b5d1a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.568033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce556b161e34ac2af03dd64ec8b5d1a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.576378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce556b161e34ac2af03dd64ec8b5d1a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.577280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce556b161e34ac2af03dd64ec8b5d1a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.586792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce556b161e34ac2af03dd64ec8b5d1a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.591490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fc73e2f37c484d8b78c0976223c899', 'request_id': 'req-7065e0fe-db35-4774-b232-e5ffc3f3bb01'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.596985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 987/1958] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:04 2022] DELETE /identity/v3/users/0ce556b161e34ac2af03dd64ec8b5d1a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:04.596985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.596985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.599640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fc73e2f37c484d8b78c0976223c899', 'request_id': 'req-7065e0fe-db35-4774-b232-e5ffc3f3bb01'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.608660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fc73e2f37c484d8b78c0976223c899', 'request_id': 'req-7065e0fe-db35-4774-b232-e5ffc3f3bb01'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.620673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] The token cache is being invalidate because project 60fc73e2f37c484d8b78c0976223c899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:04.621115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.621814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-7065e0fe-db35-4774-b232-e5ffc3f3bb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:04.623397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 972/1959] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:04 2022] DELETE /identity/v3/projects/60fc73e2f37c484d8b78c0976223c899 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:04.624697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca07c6-91f9-4dc6-9b8d-b491382317c3 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.624982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca07c6-91f9-4dc6-9b8d-b491382317c3 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.625256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca07c6-91f9-4dc6-9b8d-b491382317c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.643146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1cca07c6-91f9-4dc6-9b8d-b491382317c3 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:04.644381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1cca07c6-91f9-4dc6-9b8d-b491382317c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.665336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186bb3c-a408-4a91-b5fc-25daccf73faf admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.670604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad22d6-1ca2-4085-9a3c-d42bcb8feab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.671273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad22d6-1ca2-4085-9a3c-d42bcb8feab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.671561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad22d6-1ca2-4085-9a3c-d42bcb8feab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.671832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad22d6-1ca2-4085-9a3c-d42bcb8feab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.672543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad22d6-1ca2-4085-9a3c-d42bcb8feab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.675030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad22d6-1ca2-4085-9a3c-d42bcb8feab5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.690035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 988/1960] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:04.690035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b17cc-ae96-4a12-b81f-88a63af67745 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.690035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b17cc-ae96-4a12-b81f-88a63af67745 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.690035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b17cc-ae96-4a12-b81f-88a63af67745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.707408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 973/1961] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:04.708319 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca07c6-91f9-4dc6-9b8d-b491382317c3 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.709517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-251b17cc-ae96-4a12-b81f-88a63af67745 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:04.709912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1cca07c6-91f9-4dc6-9b8d-b491382317c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.711019 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-251b17cc-ae96-4a12-b81f-88a63af67745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.725521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 989/1962] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:04.725521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b17cc-ae96-4a12-b81f-88a63af67745 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.725521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-251b17cc-ae96-4a12-b81f-88a63af67745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.728522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca07c6-91f9-4dc6-9b8d-b491382317c3 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.733428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd3ee-a74f-4345-84b4-e51abce55450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.734158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd3ee-a74f-4345-84b4-e51abce55450 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.734442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd3ee-a74f-4345-84b4-e51abce55450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.734718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd3ee-a74f-4345-84b4-e51abce55450 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.735449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd3ee-a74f-4345-84b4-e51abce55450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.737152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd3ee-a74f-4345-84b4-e51abce55450 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.750108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 974/1963] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:04.750108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cc14-d56b-4da4-8651-743637d5ae3e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.750108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cc14-d56b-4da4-8651-743637d5ae3e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.750108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10cc14-d56b-4da4-8651-743637d5ae3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.766734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-fd10cc14-d56b-4da4-8651-743637d5ae3e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:04.767922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-fd10cc14-d56b-4da4-8651-743637d5ae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.775610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 975/1964] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:04.779347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b17cc-ae96-4a12-b81f-88a63af67745 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.779451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10cc14-d56b-4da4-8651-743637d5ae3e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.782672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1b778-2285-481f-9e2b-cc073bd50551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.783316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1b778-2285-481f-9e2b-cc073bd50551 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.783594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1b778-2285-481f-9e2b-cc073bd50551 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.783866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1b778-2285-481f-9e2b-cc073bd50551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.786096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10cc14-d56b-4da4-8651-743637d5ae3e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.790561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2938a7-9929-420a-8fd4-ac23d4fbde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.791433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2938a7-9929-420a-8fd4-ac23d4fbde37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.791712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2938a7-9929-420a-8fd4-ac23d4fbde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.791988 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2938a7-9929-420a-8fd4-ac23d4fbde37 admin admin] PATH_INFO: `/v3/projects/3d6974a3465f4096ab62e7225f26a001/users/327b20c48429419c836feae197034b32/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.793637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1b778-2285-481f-9e2b-cc073bd50551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.795116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d1b778-2285-481f-9e2b-cc073bd50551 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.804448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 990/1965] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:04.805515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1b778-2285-481f-9e2b-cc073bd50551 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.805986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2938a7-9929-420a-8fd4-ac23d4fbde37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6974a3465f4096ab62e7225f26a001, user_id=327b20c48429419c836feae197034b32, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.808649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2938a7-9929-420a-8fd4-ac23d4fbde37 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.815409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1b778-2285-481f-9e2b-cc073bd50551 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.820601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.821255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.821522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.821834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.822546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:04.822853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.823786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 976/1966] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:04 2022] PUT /identity/v3/projects/3d6974a3465f4096ab62e7225f26a001/users/327b20c48429419c836feae197034b32/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:04.824631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.829264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754f64-62c1-4180-84f9-46310819d224 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.829264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754f64-62c1-4180-84f9-46310819d224 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.829466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754f64-62c1-4180-84f9-46310819d224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.837800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 991/1967] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:04.843210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.853789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb8b5f-8cbc-4d85-a247-504b7e203c18 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:04.860572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-49754f64-62c1-4180-84f9-46310819d224 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:04.861989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-49754f64-62c1-4180-84f9-46310819d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.916788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604376bb-d121-454e-88cc-d05f62e04ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:04.917455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604376bb-d121-454e-88cc-d05f62e04ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:04.917773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604376bb-d121-454e-88cc-d05f62e04ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:04.918431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604376bb-d121-454e-88cc-d05f62e04ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:04.919080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604376bb-d121-454e-88cc-d05f62e04ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:04.920664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604376bb-d121-454e-88cc-d05f62e04ee0 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:04.926307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 977/1968] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:04.938330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49754f64-62c1-4180-84f9-46310819d224 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:04.940288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-49754f64-62c1-4180-84f9-46310819d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:04.949483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 992/1969] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:04.954519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604376bb-d121-454e-88cc-d05f62e04ee0 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:05.016496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604376bb-d121-454e-88cc-d05f62e04ee0 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:05.021218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49754f64-62c1-4180-84f9-46310819d224 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:05.022741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57319502-9d8e-4037-a2fe-95608b474fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:05.023651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319502-9d8e-4037-a2fe-95608b474fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.023939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319502-9d8e-4037-a2fe-95608b474fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.024222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319502-9d8e-4037-a2fe-95608b474fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.025253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57319502-9d8e-4037-a2fe-95608b474fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:05.027218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57319502-9d8e-4037-a2fe-95608b474fc2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:05.057623 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 993/1970] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:04 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:05.069794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57319502-9d8e-4037-a2fe-95608b474fc2 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:05.074361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:05.075759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.076163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.076500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.086897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:05.088043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57319502-9d8e-4037-a2fe-95608b474fc2 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:05.088956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:05.094552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f4245-b270-407e-886e-ede238de3ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:05.095480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4245-b270-407e-886e-ede238de3ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.095756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4245-b270-407e-886e-ede238de3ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.096036 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f4245-b270-407e-886e-ede238de3ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.096767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f4245-b270-407e-886e-ede238de3ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:05.098499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f4245-b270-407e-886e-ede238de3ecd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:05.100714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 978/1971] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:05.101672 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:05.103030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:05.115148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 994/1972] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:05.116730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f4245-b270-407e-886e-ede238de3ecd admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:05.116845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcfbdc-3477-4338-8dec-d5e2d7307fea service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:05.122522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:05.123415 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.123698 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.123974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] PATH_INFO: `/v3/projects/6a68c9cdad124fc2881ea85d32ed7a91` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.125182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a68c9cdad124fc2881ea85d32ed7a91)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:05.127257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:05.149751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f4245-b270-407e-886e-ede238de3ecd admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:05.155356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2b2a-d871-42f4-aba5-2c3885d4c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:05.157274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2b2a-d871-42f4-aba5-2c3885d4c2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.157779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2b2a-d871-42f4-aba5-2c3885d4c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.158590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2b2a-d871-42f4-aba5-2c3885d4c2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.159306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e2b2a-d871-42f4-aba5-2c3885d4c2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:05.161691 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e2b2a-d871-42f4-aba5-2c3885d4c2e1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:05.174480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 995/1973] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:05.179155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2b2a-d871-42f4-aba5-2c3885d4c2e1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:05.193058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2b2a-d871-42f4-aba5-2c3885d4c2e1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:05.198124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a68c9cdad124fc2881ea85d32ed7a91', 'request_id': 'req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.204941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a68c9cdad124fc2881ea85d32ed7a91', 'request_id': 'req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.213976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a68c9cdad124fc2881ea85d32ed7a91', 'request_id': 'req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.229005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] The token cache is being invalidate because project 6a68c9cdad124fc2881ea85d32ed7a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:05.229187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.229925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.240725 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 979/1974] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:05 2022] DELETE /identity/v3/projects/6a68c9cdad124fc2881ea85d32ed7a91 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:05.244658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:05.246121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:05.264876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c489f8-2703-49b0-bfc7-be925f6a6451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:05.265808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c489f8-2703-49b0-bfc7-be925f6a6451 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.266098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c489f8-2703-49b0-bfc7-be925f6a6451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.266362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c489f8-2703-49b0-bfc7-be925f6a6451 admin admin] PATH_INFO: `/v3/projects/c55c1fd3a8184239adde02b647c9425a/users/66412f2f40234224af32e07e735e3227/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.287503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c489f8-2703-49b0-bfc7-be925f6a6451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55c1fd3a8184239adde02b647c9425a, user_id=66412f2f40234224af32e07e735e3227, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:05.293945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c489f8-2703-49b0-bfc7-be925f6a6451 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:05.312063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 996/1975] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:05 2022] PUT /identity/v3/projects/c55c1fd3a8184239adde02b647c9425a/users/66412f2f40234224af32e07e735e3227/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:05.326021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66234d6-e17a-4dae-9a8e-5d8be7b37273 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.326680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66234d6-e17a-4dae-9a8e-5d8be7b37273 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.327572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66234d6-e17a-4dae-9a8e-5d8be7b37273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.355633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b79a-8da7-4edc-a389-3848ad3a8bbf admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:05.374065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d66234d6-e17a-4dae-9a8e-5d8be7b37273 None None] MFA Rules not processed for user `66412f2f40234224af32e07e735e3227`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:05.375498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d66234d6-e17a-4dae-9a8e-5d8be7b37273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:05.477320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:05.479769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.480256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.481030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] PATH_INFO: `/v3/users/b6ed9d9655e84e42b851bf935f200a23` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.488108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ed9d9655e84e42b851bf935f200a23)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:05.492817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:05.524078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 997/1976] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:05.574286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ed9d9655e84e42b851bf935f200a23'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.581938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66234d6-e17a-4dae-9a8e-5d8be7b37273 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:05.583274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d66234d6-e17a-4dae-9a8e-5d8be7b37273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:05.594176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ed9d9655e84e42b851bf935f200a23'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.595491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ed9d9655e84e42b851bf935f200a23'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.607586 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ed9d9655e84e42b851bf935f200a23'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.608353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8becdd32-8ed4-4ae0-9f53-ad5debe17a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ed9d9655e84e42b851bf935f200a23'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:05.653802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 980/1977] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:05 2022] DELETE /identity/v3/users/b6ed9d9655e84e42b851bf935f200a23 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:05.690233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66234d6-e17a-4dae-9a8e-5d8be7b37273 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:05.759603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:05.760656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:05.761106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:05.761594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:05.764509 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:05.874524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:05.875970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:05.886547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 998/1978] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:06.333737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.334811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a6c90-ee95-4f4b-bff4-a59076a74fa1 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.335134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a6c90-ee95-4f4b-bff4-a59076a74fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.335299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:06.335399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a6c90-ee95-4f4b-bff4-a59076a74fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.417502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5f9a6c90-ee95-4f4b-bff4-a59076a74fa1 None None] MFA Rules not processed for user `327b20c48429419c836feae197034b32`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:06.419545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5f9a6c90-ee95-4f4b-bff4-a59076a74fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:06.512037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 981/1979] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:06.517841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a6c90-ee95-4f4b-bff4-a59076a74fa1 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.519481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0b5b2-6903-475e-b37f-51a75e0e06c1 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.528002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5f9a6c90-ee95-4f4b-bff4-a59076a74fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:06.543144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.544264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.544548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.544823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] PATH_INFO: `/v3/projects/39026a98e0854af0b5c1915f66ea344d` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.547771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39026a98e0854af0b5c1915f66ea344d)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.551902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.561204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a6c90-ee95-4f4b-bff4-a59076a74fa1 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.572731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2c93d-1af0-4252-b1c1-7593a5d0021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.573411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2c93d-1af0-4252-b1c1-7593a5d0021f admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.573728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2c93d-1af0-4252-b1c1-7593a5d0021f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.574001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2c93d-1af0-4252-b1c1-7593a5d0021f admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.574695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2c93d-1af0-4252-b1c1-7593a5d0021f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.577170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2c93d-1af0-4252-b1c1-7593a5d0021f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.622469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 982/1980] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:06 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:06.624164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2c93d-1af0-4252-b1c1-7593a5d0021f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.631604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39026a98e0854af0b5c1915f66ea344d', 'request_id': 'req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:06.652485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39026a98e0854af0b5c1915f66ea344d', 'request_id': 'req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:06.664503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39026a98e0854af0b5c1915f66ea344d', 'request_id': 'req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:06.685040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] The token cache is being invalidate because project 39026a98e0854af0b5c1915f66ea344d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:06.685393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:06.686086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1a7ce1b6-4ec3-457b-8e06-543a8e3a5389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:06.694875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 999/1981] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:06 2022] DELETE /identity/v3/projects/39026a98e0854af0b5c1915f66ea344d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:06.699456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87f38-7e33-4f0e-b4ad-56edfe115217 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.699728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87f38-7e33-4f0e-b4ad-56edfe115217 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.700903 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa87f38-7e33-4f0e-b4ad-56edfe115217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.707822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2c93d-1af0-4252-b1c1-7593a5d0021f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.714615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.715903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.716783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.717272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.718678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.721316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.724447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9aa87f38-7e33-4f0e-b4ad-56edfe115217 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:06.725914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9aa87f38-7e33-4f0e-b4ad-56edfe115217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:06.735616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1000/1982] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:06.744010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283e23-2efb-4974-b988-4c7410a129ce None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.744272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283e23-2efb-4974-b988-4c7410a129ce None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.744971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283e23-2efb-4974-b988-4c7410a129ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.748794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 983/1983] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:06 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:06.752773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.756284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:06.766231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d6283e23-2efb-4974-b988-4c7410a129ce None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:06.767422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d6283e23-2efb-4974-b988-4c7410a129ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:06.772101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e9070-0e51-4f89-96a8-679bad23d6e9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.775549 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1001/1984] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:06.779613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237a2a4-911a-43e1-a1ab-3d723d5a57df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.780382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a2a4-911a-43e1-a1ab-3d723d5a57df admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.780559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a2a4-911a-43e1-a1ab-3d723d5a57df admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.780675 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283e23-2efb-4974-b988-4c7410a129ce None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.780827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a2a4-911a-43e1-a1ab-3d723d5a57df admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.782228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237a2a4-911a-43e1-a1ab-3d723d5a57df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.783924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237a2a4-911a-43e1-a1ab-3d723d5a57df admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.792026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283e23-2efb-4974-b988-4c7410a129ce None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.795212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 984/1985] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:06.798155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.798889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.799170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.799675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237a2a4-911a-43e1-a1ab-3d723d5a57df admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.799900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.800859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:06.801127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.802787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.810399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237a2a4-911a-43e1-a1ab-3d723d5a57df admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.815295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76341ec-d0c8-46cd-853b-fa49b1f362eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.816429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76341ec-d0c8-46cd-853b-fa49b1f362eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.816723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76341ec-d0c8-46cd-853b-fa49b1f362eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.816925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1002/1986] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:39:06.817076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76341ec-d0c8-46cd-853b-fa49b1f362eb admin admin] PATH_INFO: `/v3/projects/d50a39ef05a84ef5aa3c634250c6c24a/users/1a15b966171b4885a909034d6c6026c8/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.820798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.830866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1097-a570-4fd6-9448-dfcc066a433c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.835507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1983f6-d7ef-4a63-a88f-36e98e1dfa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.836206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1983f6-d7ef-4a63-a88f-36e98e1dfa8e admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.836428 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1983f6-d7ef-4a63-a88f-36e98e1dfa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.836756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1983f6-d7ef-4a63-a88f-36e98e1dfa8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.837464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1983f6-d7ef-4a63-a88f-36e98e1dfa8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.838818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76341ec-d0c8-46cd-853b-fa49b1f362eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50a39ef05a84ef5aa3c634250c6c24a, user_id=1a15b966171b4885a909034d6c6026c8, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.839318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1983f6-d7ef-4a63-a88f-36e98e1dfa8e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.841727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76341ec-d0c8-46cd-853b-fa49b1f362eb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.856114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 985/1987] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:06 2022] PUT /identity/v3/projects/d50a39ef05a84ef5aa3c634250c6c24a/users/1a15b966171b4885a909034d6c6026c8/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:06.860706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76341ec-d0c8-46cd-853b-fa49b1f362eb admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.867585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1003/1988] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:06 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:06.871528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1983f6-d7ef-4a63-a88f-36e98e1dfa8e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.930861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76341ec-d0c8-46cd-853b-fa49b1f362eb admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.937508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466e7e-1002-4f02-8290-cfdcac414c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.938285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466e7e-1002-4f02-8290-cfdcac414c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.938596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466e7e-1002-4f02-8290-cfdcac414c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.938925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466e7e-1002-4f02-8290-cfdcac414c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.939318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1983f6-d7ef-4a63-a88f-36e98e1dfa8e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.939667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79466e7e-1002-4f02-8290-cfdcac414c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.941854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79466e7e-1002-4f02-8290-cfdcac414c8f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.946978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb357d-c8c5-41bf-82b3-4f7fb77238bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.947926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb357d-c8c5-41bf-82b3-4f7fb77238bd admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.948265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb357d-c8c5-41bf-82b3-4f7fb77238bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.948659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb357d-c8c5-41bf-82b3-4f7fb77238bd admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.949362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb357d-c8c5-41bf-82b3-4f7fb77238bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.952083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb357d-c8c5-41bf-82b3-4f7fb77238bd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.962161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 986/1989] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:06.963195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466e7e-1002-4f02-8290-cfdcac414c8f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:06.973979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79466e7e-1002-4f02-8290-cfdcac414c8f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:06.979088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8d625-e300-43eb-894d-1334a8dffa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:06.980161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d625-e300-43eb-894d-1334a8dffa68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:06.980441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d625-e300-43eb-894d-1334a8dffa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:06.980722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8d625-e300-43eb-894d-1334a8dffa68 admin admin] PATH_INFO: `/v3/projects/d50a39ef05a84ef5aa3c634250c6c24a/users/1a15b966171b4885a909034d6c6026c8/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:06.982932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1004/1990] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:06 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:06.985879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8d625-e300-43eb-894d-1334a8dffa68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50a39ef05a84ef5aa3c634250c6c24a, user_id=1a15b966171b4885a909034d6c6026c8, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:06.988891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8d625-e300-43eb-894d-1334a8dffa68 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:06.994130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb357d-c8c5-41bf-82b3-4f7fb77238bd admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.000531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 987/1991] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:06 2022] PUT /identity/v3/projects/d50a39ef05a84ef5aa3c634250c6c24a/users/1a15b966171b4885a909034d6c6026c8/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:07.012030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb357d-c8c5-41bf-82b3-4f7fb77238bd admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:07.105732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e34bbf-7e5c-46bf-b1ec-7379efea9587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:07.107734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34bbf-7e5c-46bf-b1ec-7379efea9587 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.108092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34bbf-7e5c-46bf-b1ec-7379efea9587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.108451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e34bbf-7e5c-46bf-b1ec-7379efea9587 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.109273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e34bbf-7e5c-46bf-b1ec-7379efea9587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:07.111665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e34bbf-7e5c-46bf-b1ec-7379efea9587 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:07.124031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1005/1992] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:07.127674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8d625-e300-43eb-894d-1334a8dffa68 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.145761 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8d625-e300-43eb-894d-1334a8dffa68 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:07.152861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deb047-27fa-41cd-a945-6f22833edbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:07.154083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb047-27fa-41cd-a945-6f22833edbdb admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.154373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb047-27fa-41cd-a945-6f22833edbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.154907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb047-27fa-41cd-a945-6f22833edbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.155373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28deb047-27fa-41cd-a945-6f22833edbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:07.157162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28deb047-27fa-41cd-a945-6f22833edbdb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:07.173073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 988/1993] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:07.177264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e34bbf-7e5c-46bf-b1ec-7379efea9587 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.188430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e34bbf-7e5c-46bf-b1ec-7379efea9587 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:07.195149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb07d71-429c-4505-8908-ebc2e78a062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:07.196045 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07d71-429c-4505-8908-ebc2e78a062a admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.196771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07d71-429c-4505-8908-ebc2e78a062a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.197067 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb07d71-429c-4505-8908-ebc2e78a062a admin admin] PATH_INFO: `/v3/projects/15a2697455b64a89b2802b54c746e1d4/users/03819d60652e43a196ad3442ad27d1e6/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.219283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb07d71-429c-4505-8908-ebc2e78a062a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a2697455b64a89b2802b54c746e1d4, user_id=03819d60652e43a196ad3442ad27d1e6, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:07.222615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb07d71-429c-4505-8908-ebc2e78a062a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:07.252850 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1006/1994] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:07 2022] PUT /identity/v3/projects/15a2697455b64a89b2802b54c746e1d4/users/03819d60652e43a196ad3442ad27d1e6/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:07.265347 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfc7c9-2eac-47e1-8569-2381c17c3663 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.265687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfc7c9-2eac-47e1-8569-2381c17c3663 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.265969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfc7c9-2eac-47e1-8569-2381c17c3663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.335247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-45bfc7c9-2eac-47e1-8569-2381c17c3663 None None] MFA Rules not processed for user `03819d60652e43a196ad3442ad27d1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:07.336498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-45bfc7c9-2eac-47e1-8569-2381c17c3663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:07.440889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 989/1995] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:07.457144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb07d71-429c-4505-8908-ebc2e78a062a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.569938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb07d71-429c-4505-8908-ebc2e78a062a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:07.575748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:07.576564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.576853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.577132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.578005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:07.580143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:07.615759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1007/1996] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:07 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:07.619669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfc7c9-2eac-47e1-8569-2381c17c3663 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.634163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfc7c9-2eac-47e1-8569-2381c17c3663 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:07.692082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.694078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:07.735587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f6a88-f955-4cc6-a427-556a1b1ac379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:07.736922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f6a88-f955-4cc6-a427-556a1b1ac379 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.737611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f6a88-f955-4cc6-a427-556a1b1ac379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.738111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f6a88-f955-4cc6-a427-556a1b1ac379 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.739309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f6a88-f955-4cc6-a427-556a1b1ac379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:07.742772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f6a88-f955-4cc6-a427-556a1b1ac379 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:07.782179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 990/1997] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:07 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:07.785106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f6a88-f955-4cc6-a427-556a1b1ac379 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.789015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacb591-8000-42ea-8d40-17b5dd9bda06 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:07.802548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f6a88-f955-4cc6-a427-556a1b1ac379 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:07.803039 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:07.804612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.804897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.805173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] PATH_INFO: `/v3/users/693d800bf04a4949b9d38de8f80bfd38` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.808277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693d800bf04a4949b9d38de8f80bfd38)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:07.811318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3297d9b-aed2-4afc-b710-5f6b4a313975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:07.811458 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:07.812309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297d9b-aed2-4afc-b710-5f6b4a313975 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.812991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297d9b-aed2-4afc-b710-5f6b4a313975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.813405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3297d9b-aed2-4afc-b710-5f6b4a313975 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.815848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3297d9b-aed2-4afc-b710-5f6b4a313975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:07.819371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3297d9b-aed2-4afc-b710-5f6b4a313975 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:07.849619 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 991/1998] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:07.851010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3297d9b-aed2-4afc-b710-5f6b4a313975 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.863430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3297d9b-aed2-4afc-b710-5f6b4a313975 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:07.878802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82336495-b7cd-41f2-b3dd-037ac9da0639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:07.880073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82336495-b7cd-41f2-b3dd-037ac9da0639 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.880362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82336495-b7cd-41f2-b3dd-037ac9da0639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.880645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82336495-b7cd-41f2-b3dd-037ac9da0639 admin admin] PATH_INFO: `/v3/projects/698aa31752074fb3a0b7a8a4e3c62c06/users/19a65a8b3e4d4edfabf25a98b443cf92/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.903069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82336495-b7cd-41f2-b3dd-037ac9da0639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698aa31752074fb3a0b7a8a4e3c62c06, user_id=19a65a8b3e4d4edfabf25a98b443cf92, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:07.907749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82336495-b7cd-41f2-b3dd-037ac9da0639 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:07.919260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693d800bf04a4949b9d38de8f80bfd38'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:07.927553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 992/1999] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:07 2022] PUT /identity/v3/projects/698aa31752074fb3a0b7a8a4e3c62c06/users/19a65a8b3e4d4edfabf25a98b443cf92/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:07.930311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c61b1-042e-4dbd-a679-117b1b0f07ac None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:07.931053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c61b1-042e-4dbd-a679-117b1b0f07ac None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:07.931431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c61b1-042e-4dbd-a679-117b1b0f07ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:07.933534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693d800bf04a4949b9d38de8f80bfd38'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:07.945507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693d800bf04a4949b9d38de8f80bfd38'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:07.946427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693d800bf04a4949b9d38de8f80bfd38'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:07.956747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693d800bf04a4949b9d38de8f80bfd38'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:07.967558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1008/2000] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:07 2022] DELETE /identity/v3/users/693d800bf04a4949b9d38de8f80bfd38 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:07.968521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:07.970619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:07.973713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b43c61b1-042e-4dbd-a679-117b1b0f07ac None None] MFA Rules not processed for user `1a15b966171b4885a909034d6c6026c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:07.975299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b43c61b1-042e-4dbd-a679-117b1b0f07ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.061105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9203ae-02fb-4c1a-aeb3-6230a8fbe0c5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:08.069852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 993/2001] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:08.069852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aebb3-961e-4666-8ee0-ec9c95981a1b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.069852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aebb3-961e-4666-8ee0-ec9c95981a1b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.069852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1aebb3-961e-4666-8ee0-ec9c95981a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.072925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:08.073916 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.074258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.074684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.075944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:08.077792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:08.088106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ba1aebb3-961e-4666-8ee0-ec9c95981a1b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:08.089331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ba1aebb3-961e-4666-8ee0-ec9c95981a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.101376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 994/2002] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:08.101376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1aebb3-961e-4666-8ee0-ec9c95981a1b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:08.104529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ba1aebb3-961e-4666-8ee0-ec9c95981a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.108305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1009/2003] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:08.109186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:08.111240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.186176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f723b-ad00-4a78-abac-5d46735c3d73 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:08.190434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61c43b-dfdb-424d-a70a-887bb02e83a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:08.195706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c43b-dfdb-424d-a70a-887bb02e83a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.196026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c43b-dfdb-424d-a70a-887bb02e83a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.196324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c43b-dfdb-424d-a70a-887bb02e83a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.202690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1aebb3-961e-4666-8ee0-ec9c95981a1b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:08.208750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:08.209740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.210095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.210427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61c43b-dfdb-424d-a70a-887bb02e83a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:08.210606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.213846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61c43b-dfdb-424d-a70a-887bb02e83a7 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:08.214417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.226417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1010/2004] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:08.227453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61c43b-dfdb-424d-a70a-887bb02e83a7 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:08.238547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61c43b-dfdb-424d-a70a-887bb02e83a7 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:08.251171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f6e8-7ac8-42ee-9ae9-0d585e8c5ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:08.252575 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f6e8-7ac8-42ee-9ae9-0d585e8c5ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.252889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f6e8-7ac8-42ee-9ae9-0d585e8c5ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.253304 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f6e8-7ac8-42ee-9ae9-0d585e8c5ee8 admin admin] PATH_INFO: `/v3/projects/698aa31752074fb3a0b7a8a4e3c62c06/users/19a65a8b3e4d4edfabf25a98b443cf92/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.256029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f6e8-7ac8-42ee-9ae9-0d585e8c5ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698aa31752074fb3a0b7a8a4e3c62c06, user_id=19a65a8b3e4d4edfabf25a98b443cf92, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:08.260018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f6e8-7ac8-42ee-9ae9-0d585e8c5ee8 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:08.272520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1011/2005] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:08 2022] PUT /identity/v3/projects/698aa31752074fb3a0b7a8a4e3c62c06/users/19a65a8b3e4d4edfabf25a98b443cf92/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:08.283292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909e78a-2b74-433d-9925-36853cc9f2e9 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.283579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909e78a-2b74-433d-9925-36853cc9f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.283855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909e78a-2b74-433d-9925-36853cc9f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.317047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-4909e78a-2b74-433d-9925-36853cc9f2e9 None None] MFA Rules not processed for user `19a65a8b3e4d4edfabf25a98b443cf92`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:08.318617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4909e78a-2b74-433d-9925-36853cc9f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.321409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:08.324907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:08.342423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 995/2006] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:08.406538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1012/2007] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:08.420450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:08.422899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.438200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0aa22-c564-4fe4-9b0a-97e617e3b413 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:08.527444 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19bdb3-5cd3-4504-8af6-69ba76483e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:08.528815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19bdb3-5cd3-4504-8af6-69ba76483e84 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.529119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19bdb3-5cd3-4504-8af6-69ba76483e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.529817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19bdb3-5cd3-4504-8af6-69ba76483e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.543192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19bdb3-5cd3-4504-8af6-69ba76483e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:08.545559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19bdb3-5cd3-4504-8af6-69ba76483e84 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:08.555953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 996/2008] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:08.669853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909e78a-2b74-433d-9925-36853cc9f2e9 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:08.671658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4909e78a-2b74-433d-9925-36853cc9f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.697999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19bdb3-5cd3-4504-8af6-69ba76483e84 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:08.761782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909e78a-2b74-433d-9925-36853cc9f2e9 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:08.765826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:08.766688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.766970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.767244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] PATH_INFO: `/v3/projects/bfe0e8084113485fa0be9b19673db1ad` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.768709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe0e8084113485fa0be9b19673db1ad)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:08.770967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:08.817038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19bdb3-5cd3-4504-8af6-69ba76483e84 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:08.828045 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe0e8084113485fa0be9b19673db1ad', 'request_id': 'req-5466c36b-1187-4fa2-a09f-5f326399ac6e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.833725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe0e8084113485fa0be9b19673db1ad', 'request_id': 'req-5466c36b-1187-4fa2-a09f-5f326399ac6e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.841068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe0e8084113485fa0be9b19673db1ad', 'request_id': 'req-5466c36b-1187-4fa2-a09f-5f326399ac6e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.852009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] The token cache is being invalidate because project bfe0e8084113485fa0be9b19673db1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:08.852301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.852940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.857739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1013/2009] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:08 2022] DELETE /identity/v3/projects/bfe0e8084113485fa0be9b19673db1ad => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:08.857739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:08.857739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.873889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:08.874875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.875166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.875447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] PATH_INFO: `/v3/users/03819d60652e43a196ad3442ad27d1e6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.876682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03819d60652e43a196ad3442ad27d1e6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:08.878645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:08.923344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466c36b-1187-4fa2-a09f-5f326399ac6e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:08.928450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03819d60652e43a196ad3442ad27d1e6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.928857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:08.929947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:08.930381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:08.930839 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] PATH_INFO: `/v3/users/66412f2f40234224af32e07e735e3227` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:08.933645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66412f2f40234224af32e07e735e3227)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:08.936899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:08.942967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03819d60652e43a196ad3442ad27d1e6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.943676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03819d60652e43a196ad3442ad27d1e6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.951433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03819d60652e43a196ad3442ad27d1e6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.952106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03819d60652e43a196ad3442ad27d1e6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:08.968859 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 997/2010] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:08 2022] DELETE /identity/v3/users/03819d60652e43a196ad3442ad27d1e6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:08.969959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:08.971546 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:08.996846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66412f2f40234224af32e07e735e3227'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.013927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66412f2f40234224af32e07e735e3227'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.022202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66412f2f40234224af32e07e735e3227'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.023067 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66412f2f40234224af32e07e735e3227'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.031369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-28f3dc5f-e243-402a-b6ec-97b0c3f09135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66412f2f40234224af32e07e735e3227'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.037779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1014/2011] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:08 2022] DELETE /identity/v3/users/66412f2f40234224af32e07e735e3227 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:09.040677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254031-b5db-4da0-83cd-9156a856cae9 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:09.040677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254031-b5db-4da0-83cd-9156a856cae9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:09.040677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254031-b5db-4da0-83cd-9156a856cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:09.054722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d559a-0369-4e26-9a38-49ca2fd27872 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:09.061092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9e254031-b5db-4da0-83cd-9156a856cae9 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:09.062371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9e254031-b5db-4da0-83cd-9156a856cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:09.131444 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:09.132338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:09.132619 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:09.132900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] PATH_INFO: `/v3/users/48b027b738e947f1a2c79c11d751fc60` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:09.134265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b027b738e947f1a2c79c11d751fc60)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:09.136304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:09.138253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1015/2012] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:09.139783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f87ff-ad61-4a8a-9900-b84e80d1ee46 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:09.140073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f87ff-ad61-4a8a-9900-b84e80d1ee46 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:09.140384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f87ff-ad61-4a8a-9900-b84e80d1ee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:09.159055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-364f87ff-ad61-4a8a-9900-b84e80d1ee46 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:09.160260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-364f87ff-ad61-4a8a-9900-b84e80d1ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:09.169532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1016/2013] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:09.170725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f87ff-ad61-4a8a-9900-b84e80d1ee46 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:09.172420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-364f87ff-ad61-4a8a-9900-b84e80d1ee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:09.207472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b027b738e947f1a2c79c11d751fc60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.224923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b027b738e947f1a2c79c11d751fc60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.225879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b027b738e947f1a2c79c11d751fc60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.234824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b027b738e947f1a2c79c11d751fc60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.235504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b027b738e947f1a2c79c11d751fc60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:09.243459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f87ff-ad61-4a8a-9900-b84e80d1ee46 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:09.247720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:09.248368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:09.248653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:09.248929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:09.249772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 998/2014] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:08 2022] DELETE /identity/v3/users/48b027b738e947f1a2c79c11d751fc60 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:09.250375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:09.251714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:09.253494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:09.266361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:09.267565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:09.280587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1017/2015] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:09.323391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c539b1b-e637-4494-b06f-859c80d848dc admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:09.327243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:09.327925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:09.328169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:09.328440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:09.330523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:09.400799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:09.402304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:09.413322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 999/2016] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:09.839818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:09.841817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:09.859878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:09.862644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:09.881199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f43e1-b335-498f-86a9-2813e810a07a service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:09.909587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:09.909587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:09.912437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:09.912726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] PATH_INFO: `/v3/projects/446566eb20f4416d80d78267fd4b7dd8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:09.914274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446566eb20f4416d80d78267fd4b7dd8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:09.919553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:09.991084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cbba4-f9ad-49bd-89ff-6a304a9b49ab service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.011639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446566eb20f4416d80d78267fd4b7dd8', 'request_id': 'req-72a808dc-4c82-4ae7-905b-89ca01f43585'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.020310 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446566eb20f4416d80d78267fd4b7dd8', 'request_id': 'req-72a808dc-4c82-4ae7-905b-89ca01f43585'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.030737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446566eb20f4416d80d78267fd4b7dd8', 'request_id': 'req-72a808dc-4c82-4ae7-905b-89ca01f43585'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.047461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] The token cache is being invalidate because project 446566eb20f4416d80d78267fd4b7dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:10.048646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.049341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.051359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1000/2017] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:09 2022] DELETE /identity/v3/projects/446566eb20f4416d80d78267fd4b7dd8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:10.052264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.057680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:10.068312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdc38d-0955-402f-bee4-307b01f874f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.069102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc38d-0955-402f-bee4-307b01f874f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.069488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc38d-0955-402f-bee4-307b01f874f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.069897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc38d-0955-402f-bee4-307b01f874f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.072419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0ffdc38d-0955-402f-bee4-307b01f874f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:10.151943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a808dc-4c82-4ae7-905b-89ca01f43585 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.157754 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.158934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.159216 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.159490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] PATH_INFO: `/v3/projects/c55c1fd3a8184239adde02b647c9425a` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.161991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c55c1fd3a8184239adde02b647c9425a)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.164133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.185332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdc38d-0955-402f-bee4-307b01f874f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.189667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdc38d-0955-402f-bee4-307b01f874f5 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.211825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1018/2018] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:10.213459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c3c8-bd66-492f-8914-0489f4c5e4b5 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.214126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c3c8-bd66-492f-8914-0489f4c5e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.214126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c3c8-bd66-492f-8914-0489f4c5e4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.235869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c55c1fd3a8184239adde02b647c9425a', 'request_id': 'req-8ddc9572-6497-4c8d-b322-1ee15c4bc647'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.242405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-2a94c3c8-bd66-492f-8914-0489f4c5e4b5 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:10.245512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c55c1fd3a8184239adde02b647c9425a', 'request_id': 'req-8ddc9572-6497-4c8d-b322-1ee15c4bc647'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.245940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2a94c3c8-bd66-492f-8914-0489f4c5e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:10.258270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c55c1fd3a8184239adde02b647c9425a', 'request_id': 'req-8ddc9572-6497-4c8d-b322-1ee15c4bc647'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.278493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] The token cache is being invalidate because project c55c1fd3a8184239adde02b647c9425a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:10.278861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.280088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-8ddc9572-6497-4c8d-b322-1ee15c4bc647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.285628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1001/2019] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:10 2022] DELETE /identity/v3/projects/c55c1fd3a8184239adde02b647c9425a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:10.355063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1019/2020] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:10.363726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478fad2-e936-4aa8-a00c-83a6f04cff9d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.364053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478fad2-e936-4aa8-a00c-83a6f04cff9d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.364326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478fad2-e936-4aa8-a00c-83a6f04cff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.385508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c3c8-bd66-492f-8914-0489f4c5e4b5 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.390644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2a94c3c8-bd66-492f-8914-0489f4c5e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:10.410646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d478fad2-e936-4aa8-a00c-83a6f04cff9d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:10.411891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d478fad2-e936-4aa8-a00c-83a6f04cff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:10.415392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c3c8-bd66-492f-8914-0489f4c5e4b5 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.430080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1002/2021] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:10.445728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.446699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.446983 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.447258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] PATH_INFO: `/v3/projects/15a2697455b64a89b2802b54c746e1d4` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.448632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a2697455b64a89b2802b54c746e1d4)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.451166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.455500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478fad2-e936-4aa8-a00c-83a6f04cff9d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.494026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478fad2-e936-4aa8-a00c-83a6f04cff9d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.511819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a2697455b64a89b2802b54c746e1d4', 'request_id': 'req-04a7c80b-0905-43d1-9f26-0977d0c058c6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.524016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a2697455b64a89b2802b54c746e1d4', 'request_id': 'req-04a7c80b-0905-43d1-9f26-0977d0c058c6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.535902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a2697455b64a89b2802b54c746e1d4', 'request_id': 'req-04a7c80b-0905-43d1-9f26-0977d0c058c6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.554351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] The token cache is being invalidate because project 15a2697455b64a89b2802b54c746e1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:10.554874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.555687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.558022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1020/2022] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:10 2022] DELETE /identity/v3/projects/15a2697455b64a89b2802b54c746e1d4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:10.563178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.579122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:10.581515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.582227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.582584 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.582875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.583606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:10.584474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.586595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.601127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7c80b-0905-43d1-9f26-0977d0c058c6 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.609630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1003/2023] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:10.614308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.614524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.614524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.614685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.614964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] PATH_INFO: `/v3/users/19a65a8b3e4d4edfabf25a98b443cf92` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.626200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:10.626303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a65a8b3e4d4edfabf25a98b443cf92)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.626303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.635539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08fcbb-c888-47ec-95d0-0f962afdf48c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.641361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804e7f5-627f-4b36-ab35-6878bacbc992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.642130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e7f5-627f-4b36-ab35-6878bacbc992 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.642511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e7f5-627f-4b36-ab35-6878bacbc992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.642855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804e7f5-627f-4b36-ab35-6878bacbc992 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.643582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804e7f5-627f-4b36-ab35-6878bacbc992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.645485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804e7f5-627f-4b36-ab35-6878bacbc992 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.672214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a65a8b3e4d4edfabf25a98b443cf92'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.677704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1004/2024] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:10 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:10.680891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804e7f5-627f-4b36-ab35-6878bacbc992 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.689077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a65a8b3e4d4edfabf25a98b443cf92'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.696255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a65a8b3e4d4edfabf25a98b443cf92'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.697034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a65a8b3e4d4edfabf25a98b443cf92'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.708314 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a65a8b3e4d4edfabf25a98b443cf92'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:10.715278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1021/2025] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:10 2022] DELETE /identity/v3/users/19a65a8b3e4d4edfabf25a98b443cf92 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:10.755641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804e7f5-627f-4b36-ab35-6878bacbc992 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.821414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8254b4-afb0-4181-be46-b98a1d88c7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.829665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8254b4-afb0-4181-be46-b98a1d88c7de admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.830123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8254b4-afb0-4181-be46-b98a1d88c7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.830523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8254b4-afb0-4181-be46-b98a1d88c7de admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.831264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8254b4-afb0-4181-be46-b98a1d88c7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.833323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8254b4-afb0-4181-be46-b98a1d88c7de admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.858608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1005/2026] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:10 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:10.862773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.864239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:10.884381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033186e-2a5c-4734-b284-58c40d1106d0 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.892081 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef32e7c-6720-4331-8b6f-d7df30aeb8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.892995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32e7c-6720-4331-8b6f-d7df30aeb8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.893420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32e7c-6720-4331-8b6f-d7df30aeb8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.893869 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef32e7c-6720-4331-8b6f-d7df30aeb8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.894981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32e7c-6720-4331-8b6f-d7df30aeb8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.897601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef32e7c-6720-4331-8b6f-d7df30aeb8ce admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.914844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1022/2027] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:10.918600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8254b4-afb0-4181-be46-b98a1d88c7de admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.930733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8254b4-afb0-4181-be46-b98a1d88c7de admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.936996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c160a-b3dd-42b3-9b80-2c128a248144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.937789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c160a-b3dd-42b3-9b80-2c128a248144 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.938075 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c160a-b3dd-42b3-9b80-2c128a248144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.938353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c160a-b3dd-42b3-9b80-2c128a248144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.939090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c160a-b3dd-42b3-9b80-2c128a248144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.940972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c160a-b3dd-42b3-9b80-2c128a248144 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:10.953594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1006/2028] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:10.957703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef32e7c-6720-4331-8b6f-d7df30aeb8ce admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:10.968816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef32e7c-6720-4331-8b6f-d7df30aeb8ce admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:10.973577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:10.977136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:10.977136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:10.977136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] PATH_INFO: `/v3/projects/4019fa5024af4d5da0f22be92ad98e51/users/0b3a37a1b75843e1991e0e936c1c597d/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:10.996916 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4019fa5024af4d5da0f22be92ad98e51, user_id=0b3a37a1b75843e1991e0e936c1c597d, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:10.999625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.025633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1023/2029] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:10 2022] PUT /identity/v3/projects/4019fa5024af4d5da0f22be92ad98e51/users/0b3a37a1b75843e1991e0e936c1c597d/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:11.029398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1128db4-66d8-4164-86f3-e03f3682675b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.030494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1128db4-66d8-4164-86f3-e03f3682675b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.031667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1128db4-66d8-4164-86f3-e03f3682675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.068262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.070470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:11.079644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d1128db4-66d8-4164-86f3-e03f3682675b None None] MFA Rules not processed for user `0b3a37a1b75843e1991e0e936c1c597d`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:11.081961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d1128db4-66d8-4164-86f3-e03f3682675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:11.157982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc660cd6-dd8b-4154-8615-d8969563f670 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.163343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1007/2030] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:11.167745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1128db4-66d8-4164-86f3-e03f3682675b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.171347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.174788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.175083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.175372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] PATH_INFO: `/v3/projects/698aa31752074fb3a0b7a8a4e3c62c06` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.178500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698aa31752074fb3a0b7a8a4e3c62c06)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.182070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.183873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1128db4-66d8-4164-86f3-e03f3682675b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.196506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35a3d1-0578-4dbb-90f1-ee33b0f5e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.197931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35a3d1-0578-4dbb-90f1-ee33b0f5e414 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.198591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35a3d1-0578-4dbb-90f1-ee33b0f5e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.199120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35a3d1-0578-4dbb-90f1-ee33b0f5e414 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.200911 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35a3d1-0578-4dbb-90f1-ee33b0f5e414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.204254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35a3d1-0578-4dbb-90f1-ee33b0f5e414 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.244664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1008/2031] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:11.248580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35a3d1-0578-4dbb-90f1-ee33b0f5e414 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.283404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698aa31752074fb3a0b7a8a4e3c62c06', 'request_id': 'req-22df34ee-4605-4542-82f3-3d6582c1cc45'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:11.292269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698aa31752074fb3a0b7a8a4e3c62c06', 'request_id': 'req-22df34ee-4605-4542-82f3-3d6582c1cc45'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:11.305103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698aa31752074fb3a0b7a8a4e3c62c06', 'request_id': 'req-22df34ee-4605-4542-82f3-3d6582c1cc45'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:11.339063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35a3d1-0578-4dbb-90f1-ee33b0f5e414 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.341670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] The token cache is being invalidate because project 698aa31752074fb3a0b7a8a4e3c62c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:11.342189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:11.343546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22df34ee-4605-4542-82f3-3d6582c1cc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:11.347348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1024/2032] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:11 2022] DELETE /identity/v3/projects/698aa31752074fb3a0b7a8a4e3c62c06 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:11.352360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67844a-25e7-4826-911f-c04204af3391 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.352862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67844a-25e7-4826-911f-c04204af3391 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.353343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67844a-25e7-4826-911f-c04204af3391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.395648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-be67844a-25e7-4826-911f-c04204af3391 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:11.397080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-be67844a-25e7-4826-911f-c04204af3391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:11.417713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.418497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.419375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.419753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.420722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.422806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.455041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1009/2033] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:11.463147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.467181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:11.505527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d16f70-33b2-4910-a6d9-3508323a01e3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.508663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1025/2034] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:11.514713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9994e-86f7-4dcc-a329-741f346d6d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.515422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9994e-86f7-4dcc-a329-741f346d6d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.515706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9994e-86f7-4dcc-a329-741f346d6d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.515980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9994e-86f7-4dcc-a329-741f346d6d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.516718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9994e-86f7-4dcc-a329-741f346d6d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.518091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65025-d326-4cc0-a7a7-fdea620701d7 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.518366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9994e-86f7-4dcc-a329-741f346d6d8e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.518495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65025-d326-4cc0-a7a7-fdea620701d7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.518701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65025-d326-4cc0-a7a7-fdea620701d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.533372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1010/2035] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:11.534607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9994e-86f7-4dcc-a329-741f346d6d8e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.545576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-7dc65025-d326-4cc0-a7a7-fdea620701d7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:11.546660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9994e-86f7-4dcc-a329-741f346d6d8e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.546804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7dc65025-d326-4cc0-a7a7-fdea620701d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:11.552408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3008d4e-40c1-4148-893f-addef5b5d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.553222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3008d4e-40c1-4148-893f-addef5b5d7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.553935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3008d4e-40c1-4148-893f-addef5b5d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.554220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3008d4e-40c1-4148-893f-addef5b5d7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.555170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3008d4e-40c1-4148-893f-addef5b5d7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.557242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3008d4e-40c1-4148-893f-addef5b5d7c5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.558068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1026/2036] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:11.562747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc65025-d326-4cc0-a7a7-fdea620701d7 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.574026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1011/2037] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:11.576028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc65025-d326-4cc0-a7a7-fdea620701d7 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.576269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3008d4e-40c1-4148-893f-addef5b5d7c5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.582415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.585776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.585776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.585776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.585776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:11.586138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.588593 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.591501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3008d4e-40c1-4148-893f-addef5b5d7c5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.597187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ade70-f8bc-4f87-a6d6-682dfc358ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.598174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ade70-f8bc-4f87-a6d6-682dfc358ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.598465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ade70-f8bc-4f87-a6d6-682dfc358ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.598746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ade70-f8bc-4f87-a6d6-682dfc358ef8 admin admin] PATH_INFO: `/v3/projects/0744b97888834a0192d17859bfb0b026/users/b9a9c892ce73463fb518ef74b14e5165/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.605223 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1027/2038] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:39:11.610729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.617480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ade70-f8bc-4f87-a6d6-682dfc358ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0744b97888834a0192d17859bfb0b026, user_id=b9a9c892ce73463fb518ef74b14e5165, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.620475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ade70-f8bc-4f87-a6d6-682dfc358ef8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.635853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a59ca3-2c48-42b0-9932-48b07f8faf89 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.652405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1012/2039] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:11 2022] PUT /identity/v3/projects/0744b97888834a0192d17859bfb0b026/users/b9a9c892ce73463fb518ef74b14e5165/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:11.655235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea29403-8662-4432-9b4d-56fa64c53984 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.655666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea29403-8662-4432-9b4d-56fa64c53984 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.655994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea29403-8662-4432-9b4d-56fa64c53984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.691448 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-aea29403-8662-4432-9b4d-56fa64c53984 None None] MFA Rules not processed for user `b9a9c892ce73463fb518ef74b14e5165`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:11.693174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-aea29403-8662-4432-9b4d-56fa64c53984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:11.769319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ff7c9-0cd5-41d2-8323-3da004678127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.770265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ff7c9-0cd5-41d2-8323-3da004678127 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.770603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ff7c9-0cd5-41d2-8323-3da004678127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.770830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ff7c9-0cd5-41d2-8323-3da004678127 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.771761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ff7c9-0cd5-41d2-8323-3da004678127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.776699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ff7c9-0cd5-41d2-8323-3da004678127 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.792208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1013/2040] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:11.797992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea29403-8662-4432-9b4d-56fa64c53984 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.812835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea29403-8662-4432-9b4d-56fa64c53984 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.820786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033934c8-2ec6-4712-b042-977f6ac6b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.821587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033934c8-2ec6-4712-b042-977f6ac6b852 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.821944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033934c8-2ec6-4712-b042-977f6ac6b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.822300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033934c8-2ec6-4712-b042-977f6ac6b852 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.823178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033934c8-2ec6-4712-b042-977f6ac6b852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.825409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033934c8-2ec6-4712-b042-977f6ac6b852 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:11.832489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1028/2041] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:11.833761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ff7c9-0cd5-41d2-8323-3da004678127 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.866056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1014/2042] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:11.870215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033934c8-2ec6-4712-b042-977f6ac6b852 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:11.945226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ff7c9-0cd5-41d2-8323-3da004678127 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.968798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033934c8-2ec6-4712-b042-977f6ac6b852 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:11.983226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3216-c182-4b12-843b-24cdbc85d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:11.984775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3216-c182-4b12-843b-24cdbc85d8df admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:11.985769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3216-c182-4b12-843b-24cdbc85d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:11.986817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3216-c182-4b12-843b-24cdbc85d8df admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:11.988570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada3216-c182-4b12-843b-24cdbc85d8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:11.993253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada3216-c182-4b12-843b-24cdbc85d8df admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.037018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1015/2043] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:12.040576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3216-c182-4b12-843b-24cdbc85d8df admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.054780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3216-c182-4b12-843b-24cdbc85d8df admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.059914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04bff-a01e-490a-beef-5ad3ebbfd3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.060598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04bff-a01e-490a-beef-5ad3ebbfd3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.060886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04bff-a01e-490a-beef-5ad3ebbfd3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.061157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04bff-a01e-490a-beef-5ad3ebbfd3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.062124 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e04bff-a01e-490a-beef-5ad3ebbfd3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.063912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e04bff-a01e-490a-beef-5ad3ebbfd3a5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.068151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3c9c-8c11-4921-9fb9-fe01266d6f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.069853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3c9c-8c11-4921-9fb9-fe01266d6f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.070142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3c9c-8c11-4921-9fb9-fe01266d6f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.070424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e3c9c-8c11-4921-9fb9-fe01266d6f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.072905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e3c9c-8c11-4921-9fb9-fe01266d6f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.075877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e3c9c-8c11-4921-9fb9-fe01266d6f13 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.098404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1029/2044] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:11 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:12.099387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1016/2045] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:12.100202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04bff-a01e-490a-beef-5ad3ebbfd3a5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.102242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3c9c-8c11-4921-9fb9-fe01266d6f13 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.111556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04bff-a01e-490a-beef-5ad3ebbfd3a5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.116385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e3c9c-8c11-4921-9fb9-fe01266d6f13 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.117354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137a54-d849-4672-b056-d2305c52aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.118389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137a54-d849-4672-b056-d2305c52aeef admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.118832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137a54-d849-4672-b056-d2305c52aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.118988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137a54-d849-4672-b056-d2305c52aeef admin admin] PATH_INFO: `/v3/projects/d0d644d0b20c47df99f7b9fdcfc5db82/users/35cf9e103daa47818a7e3e58356f06f6/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.125187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76a88f-44d7-4dad-8f22-670f473d978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.125964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76a88f-44d7-4dad-8f22-670f473d978c admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.126254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76a88f-44d7-4dad-8f22-670f473d978c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.126535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76a88f-44d7-4dad-8f22-670f473d978c admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.127294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76a88f-44d7-4dad-8f22-670f473d978c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.130916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76a88f-44d7-4dad-8f22-670f473d978c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.136993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137a54-d849-4672-b056-d2305c52aeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d644d0b20c47df99f7b9fdcfc5db82, user_id=35cf9e103daa47818a7e3e58356f06f6, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.140525 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137a54-d849-4672-b056-d2305c52aeef admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.150472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1017/2046] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:12.152471 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76a88f-44d7-4dad-8f22-670f473d978c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.162515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76a88f-44d7-4dad-8f22-670f473d978c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.164479 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1030/2047] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:12 2022] PUT /identity/v3/projects/d0d644d0b20c47df99f7b9fdcfc5db82/users/35cf9e103daa47818a7e3e58356f06f6/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:12.170287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137a54-d849-4672-b056-d2305c52aeef admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.248244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137a54-d849-4672-b056-d2305c52aeef admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.248455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fe178-82b0-4cc6-954e-37fb1ed260dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.249120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fe178-82b0-4cc6-954e-37fb1ed260dd admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.249407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fe178-82b0-4cc6-954e-37fb1ed260dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.249719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fe178-82b0-4cc6-954e-37fb1ed260dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.250453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fe178-82b0-4cc6-954e-37fb1ed260dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.252065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fe178-82b0-4cc6-954e-37fb1ed260dd admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.259810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a14e9-6d15-4804-bfbc-5f068f776173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.260534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a14e9-6d15-4804-bfbc-5f068f776173 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.260912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a14e9-6d15-4804-bfbc-5f068f776173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.261491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a14e9-6d15-4804-bfbc-5f068f776173 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.262333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a14e9-6d15-4804-bfbc-5f068f776173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.264231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a14e9-6d15-4804-bfbc-5f068f776173 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.268729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1018/2048] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:12.272574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fe178-82b0-4cc6-954e-37fb1ed260dd admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.281224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1031/2049] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:12.282159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a14e9-6d15-4804-bfbc-5f068f776173 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.282737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fe178-82b0-4cc6-954e-37fb1ed260dd admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.287257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a26546-1606-4a6e-a917-a63de7c8360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.288145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26546-1606-4a6e-a917-a63de7c8360a admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.288426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26546-1606-4a6e-a917-a63de7c8360a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.288703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a26546-1606-4a6e-a917-a63de7c8360a admin admin] PATH_INFO: `/v3/projects/350d9c29f9ac40a6811c5f97b9b92da0/users/aaa1bfa9e3f34a509da6933caa1aeacc/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.292877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a14e9-6d15-4804-bfbc-5f068f776173 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.299972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea64c0-69b3-4e7e-bf73-4dd3a6c9a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.300872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea64c0-69b3-4e7e-bf73-4dd3a6c9a0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.301158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea64c0-69b3-4e7e-bf73-4dd3a6c9a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.301459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea64c0-69b3-4e7e-bf73-4dd3a6c9a0d9 admin admin] PATH_INFO: `/v3/projects/d0d644d0b20c47df99f7b9fdcfc5db82/users/35cf9e103daa47818a7e3e58356f06f6/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.303722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea64c0-69b3-4e7e-bf73-4dd3a6c9a0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d644d0b20c47df99f7b9fdcfc5db82, user_id=35cf9e103daa47818a7e3e58356f06f6, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.305741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a26546-1606-4a6e-a917-a63de7c8360a admin admin] RBAC: Authorizing `identity:create_grant(project_id=350d9c29f9ac40a6811c5f97b9b92da0, user_id=aaa1bfa9e3f34a509da6933caa1aeacc, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.306576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea64c0-69b3-4e7e-bf73-4dd3a6c9a0d9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.308386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a26546-1606-4a6e-a917-a63de7c8360a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.318929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1032/2050] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:12 2022] PUT /identity/v3/projects/d0d644d0b20c47df99f7b9fdcfc5db82/users/35cf9e103daa47818a7e3e58356f06f6/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:12.329756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132f3f-65ec-48e7-aac7-d3d1505a55db None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.330054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132f3f-65ec-48e7-aac7-d3d1505a55db None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.330333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32132f3f-65ec-48e7-aac7-d3d1505a55db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.338159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1019/2051] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:12 2022] PUT /identity/v3/projects/350d9c29f9ac40a6811c5f97b9b92da0/users/aaa1bfa9e3f34a509da6933caa1aeacc/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:12.351311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb699-f94e-474d-97a1-f48fac648a24 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.351850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb699-f94e-474d-97a1-f48fac648a24 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.352578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb699-f94e-474d-97a1-f48fac648a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.368987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-32132f3f-65ec-48e7-aac7-d3d1505a55db None None] MFA Rules not processed for user `35cf9e103daa47818a7e3e58356f06f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:12.370315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-32132f3f-65ec-48e7-aac7-d3d1505a55db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:12.384703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-70beb699-f94e-474d-97a1-f48fac648a24 None None] MFA Rules not processed for user `aaa1bfa9e3f34a509da6933caa1aeacc`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:12.386135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-70beb699-f94e-474d-97a1-f48fac648a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:12.443000 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1033/2052] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:12.462145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32132f3f-65ec-48e7-aac7-d3d1505a55db None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.463975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-32132f3f-65ec-48e7-aac7-d3d1505a55db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:12.465290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1020/2053] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:12.472468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb699-f94e-474d-97a1-f48fac648a24 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.533792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32132f3f-65ec-48e7-aac7-d3d1505a55db None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.538538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c68890-87eb-4f67-8bcf-627e7dd4d4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.539355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c68890-87eb-4f67-8bcf-627e7dd4d4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.539959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c68890-87eb-4f67-8bcf-627e7dd4d4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.540297 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c68890-87eb-4f67-8bcf-627e7dd4d4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.551383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c68890-87eb-4f67-8bcf-627e7dd4d4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.552835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c68890-87eb-4f67-8bcf-627e7dd4d4d6 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.567253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1034/2054] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:12.573747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb699-f94e-474d-97a1-f48fac648a24 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.578605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f7f5-305d-4b26-b0a2-10af2549bdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.579347 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f7f5-305d-4b26-b0a2-10af2549bdad admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.579567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f7f5-305d-4b26-b0a2-10af2549bdad admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.579839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5f7f5-305d-4b26-b0a2-10af2549bdad admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.580533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5f7f5-305d-4b26-b0a2-10af2549bdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.582540 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5f7f5-305d-4b26-b0a2-10af2549bdad admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.622279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1021/2055] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:12 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:12.626110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c68890-87eb-4f67-8bcf-627e7dd4d4d6 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.636888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c68890-87eb-4f67-8bcf-627e7dd4d4d6 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.704787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144213e-ebaa-4aa5-8266-510ab59f81c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.705740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144213e-ebaa-4aa5-8266-510ab59f81c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.706061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144213e-ebaa-4aa5-8266-510ab59f81c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.706299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144213e-ebaa-4aa5-8266-510ab59f81c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.707106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144213e-ebaa-4aa5-8266-510ab59f81c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.709034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144213e-ebaa-4aa5-8266-510ab59f81c7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.745006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1035/2056] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:12 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:12.746379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f7f5-305d-4b26-b0a2-10af2549bdad admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.759399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5f7f5-305d-4b26-b0a2-10af2549bdad admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.765017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5546d8-305f-480c-9d6a-6eb3e2ad4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.766089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5546d8-305f-480c-9d6a-6eb3e2ad4e42 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.766442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5546d8-305f-480c-9d6a-6eb3e2ad4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.766951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5546d8-305f-480c-9d6a-6eb3e2ad4e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.767877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5546d8-305f-480c-9d6a-6eb3e2ad4e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.769708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5546d8-305f-480c-9d6a-6eb3e2ad4e42 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.785970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1022/2057] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:12.787229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144213e-ebaa-4aa5-8266-510ab59f81c7 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.804808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144213e-ebaa-4aa5-8266-510ab59f81c7 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.818075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570a683-8e39-4c1c-ac57-11fd7d2e15a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.819386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a683-8e39-4c1c-ac57-11fd7d2e15a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.819386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a683-8e39-4c1c-ac57-11fd7d2e15a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.819559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a683-8e39-4c1c-ac57-11fd7d2e15a8 admin admin] PATH_INFO: `/v3/projects/7bbd8f6757f54a6bb13e3a48793e9e06/users/9e29bae937de4370bd1f8730fdec3979/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.843219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570a683-8e39-4c1c-ac57-11fd7d2e15a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbd8f6757f54a6bb13e3a48793e9e06, user_id=9e29bae937de4370bd1f8730fdec3979, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.846273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570a683-8e39-4c1c-ac57-11fd7d2e15a8 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.866869 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1036/2058] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:12 2022] PUT /identity/v3/projects/7bbd8f6757f54a6bb13e3a48793e9e06/users/9e29bae937de4370bd1f8730fdec3979/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:12.870649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5546d8-305f-480c-9d6a-6eb3e2ad4e42 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.885306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5546d8-305f-480c-9d6a-6eb3e2ad4e42 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.952503 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26fcd0-1a80-4e41-90a0-613ae6cd12f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.953182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fcd0-1a80-4e41-90a0-613ae6cd12f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.953473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fcd0-1a80-4e41-90a0-613ae6cd12f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.953808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fcd0-1a80-4e41-90a0-613ae6cd12f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.954542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26fcd0-1a80-4e41-90a0-613ae6cd12f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:12.956208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26fcd0-1a80-4e41-90a0-613ae6cd12f6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:12.969609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1023/2059] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:12.973848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570a683-8e39-4c1c-ac57-11fd7d2e15a8 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:12.985997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570a683-8e39-4c1c-ac57-11fd7d2e15a8 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:12.991953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:12.992829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:12.993114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:12.993391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] PATH_INFO: `/v3/projects/7bbd8f6757f54a6bb13e3a48793e9e06/users/9e29bae937de4370bd1f8730fdec3979/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:12.997669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbd8f6757f54a6bb13e3a48793e9e06, user_id=9e29bae937de4370bd1f8730fdec3979, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:13.001947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:13.015557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1037/2060] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:12 2022] PUT /identity/v3/projects/7bbd8f6757f54a6bb13e3a48793e9e06/users/9e29bae937de4370bd1f8730fdec3979/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:13.032286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2d94-8c58-466e-a009-e9911a6e94c3 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:13.032286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2d94-8c58-466e-a009-e9911a6e94c3 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:13.032286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db2d94-8c58-466e-a009-e9911a6e94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:13.053691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-00db2d94-8c58-466e-a009-e9911a6e94c3 None None] MFA Rules not processed for user `9e29bae937de4370bd1f8730fdec3979`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:13.054884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-00db2d94-8c58-466e-a009-e9911a6e94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:13.135483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1024/2061] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:13.174317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:13.177863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:13.181216 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db2d94-8c58-466e-a009-e9911a6e94c3 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:13.234070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d7689-8f54-4fba-8e9e-3aed04455754 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:13.234483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db2d94-8c58-466e-a009-e9911a6e94c3 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:13.237953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17655c68-32ec-4fe8-a2ad-1d658c12b0ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:13.238107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:13.238586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17655c68-32ec-4fe8-a2ad-1d658c12b0ea service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:13.238691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:13.238873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17655c68-32ec-4fe8-a2ad-1d658c12b0ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:13.238989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:13.239148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17655c68-32ec-4fe8-a2ad-1d658c12b0ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:13.239255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:13.240931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:13.297258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17655c68-32ec-4fe8-a2ad-1d658c12b0ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:13.298638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17655c68-32ec-4fe8-a2ad-1d658c12b0ea service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:13.299566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:13.301001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:13.307486 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1038/2062] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:13.309818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1025/2063] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:17.545800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17655c68-32ec-4fe8-a2ad-1d658c12b0ea service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:17.555738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17655c68-32ec-4fe8-a2ad-1d658c12b0ea service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:17.559927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989ca95-d6e6-49eb-b208-8a6003b08335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:17.560760 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989ca95-d6e6-49eb-b208-8a6003b08335 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:17.561040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989ca95-d6e6-49eb-b208-8a6003b08335 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:17.561317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989ca95-d6e6-49eb-b208-8a6003b08335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:17.635401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989ca95-d6e6-49eb-b208-8a6003b08335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:17.636967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989ca95-d6e6-49eb-b208-8a6003b08335 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:17.645956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1039/2064] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:17.852362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:17.862627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14c0c-7991-4174-ab62-cde948a6c616 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:17.866731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2618fbb-be2e-4400-8e6b-c426e2a64b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:17.867641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618fbb-be2e-4400-8e6b-c426e2a64b85 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:17.868101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618fbb-be2e-4400-8e6b-c426e2a64b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:17.868205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618fbb-be2e-4400-8e6b-c426e2a64b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:17.879883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2618fbb-be2e-4400-8e6b-c426e2a64b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:17.881353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2618fbb-be2e-4400-8e6b-c426e2a64b85 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:17.893201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1026/2065] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:20.020602 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989ca95-d6e6-49eb-b208-8a6003b08335 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:20.085226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989ca95-d6e6-49eb-b208-8a6003b08335 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:20.089694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:20.090595 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:20.090879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:20.091152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] PATH_INFO: `/v3/users/0b3a37a1b75843e1991e0e936c1c597d` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:20.092335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3a37a1b75843e1991e0e936c1c597d)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:20.094279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:20.139867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3a37a1b75843e1991e0e936c1c597d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.151846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3a37a1b75843e1991e0e936c1c597d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.158652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3a37a1b75843e1991e0e936c1c597d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.159341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3a37a1b75843e1991e0e936c1c597d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.166508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3a37a1b75843e1991e0e936c1c597d'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.172653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1040/2066] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:20 2022] DELETE /identity/v3/users/0b3a37a1b75843e1991e0e936c1c597d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:20.176991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322e5f1-baf0-433e-85c0-c41cff3330e3 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:20.177495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322e5f1-baf0-433e-85c0-c41cff3330e3 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:20.177637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322e5f1-baf0-433e-85c0-c41cff3330e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:20.195573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8322e5f1-baf0-433e-85c0-c41cff3330e3 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:20.196832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8322e5f1-baf0-433e-85c0-c41cff3330e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:20.270845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1027/2067] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:20.280262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:20.281690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:20.338231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d2e6f-cc1d-4059-9823-afe17533af4b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:20.341862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c087c-a301-44da-b5ad-ceab373f4fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:20.342520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c087c-a301-44da-b5ad-ceab373f4fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:20.342783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c087c-a301-44da-b5ad-ceab373f4fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:20.343057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c087c-a301-44da-b5ad-ceab373f4fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:20.351570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c087c-a301-44da-b5ad-ceab373f4fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:20.352996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c087c-a301-44da-b5ad-ceab373f4fb8 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:20.362669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1041/2068] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:20.639224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322e5f1-baf0-433e-85c0-c41cff3330e3 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:20.640711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8322e5f1-baf0-433e-85c0-c41cff3330e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:20.657188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322e5f1-baf0-433e-85c0-c41cff3330e3 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:20.662944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:20.664179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:20.664469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:20.664749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] PATH_INFO: `/v3/projects/4019fa5024af4d5da0f22be92ad98e51` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:20.666368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4019fa5024af4d5da0f22be92ad98e51)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:20.668306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:20.718751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4019fa5024af4d5da0f22be92ad98e51', 'request_id': 'req-48c6627c-b556-4dad-8bea-04e9b5d2bf76'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.724283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4019fa5024af4d5da0f22be92ad98e51', 'request_id': 'req-48c6627c-b556-4dad-8bea-04e9b5d2bf76'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.731578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4019fa5024af4d5da0f22be92ad98e51', 'request_id': 'req-48c6627c-b556-4dad-8bea-04e9b5d2bf76'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.742843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] The token cache is being invalidate because project 4019fa5024af4d5da0f22be92ad98e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:20.743127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.743771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.745289 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1028/2069] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:20 2022] DELETE /identity/v3/projects/4019fa5024af4d5da0f22be92ad98e51 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:20.749244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c087c-a301-44da-b5ad-ceab373f4fb8 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:20.758428 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c087c-a301-44da-b5ad-ceab373f4fb8 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:20.812836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:20.813760 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:20.814040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:20.814328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] PATH_INFO: `/v3/users/b9a9c892ce73463fb518ef74b14e5165` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:20.815489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a9c892ce73463fb518ef74b14e5165)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:20.817670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:20.863647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a9c892ce73463fb518ef74b14e5165'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.876321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a9c892ce73463fb518ef74b14e5165'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.883333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a9c892ce73463fb518ef74b14e5165'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.884140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a9c892ce73463fb518ef74b14e5165'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.894468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a9c892ce73463fb518ef74b14e5165'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:20.903762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1042/2070] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:20 2022] DELETE /identity/v3/users/b9a9c892ce73463fb518ef74b14e5165 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:21.336509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:21.337996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:21.354780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6627c-b556-4dad-8bea-04e9b5d2bf76 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:21.417152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:21.418074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:21.418395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:21.418678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] PATH_INFO: `/v3/projects/0744b97888834a0192d17859bfb0b026` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:21.420116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0744b97888834a0192d17859bfb0b026)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:21.422436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:21.478110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0744b97888834a0192d17859bfb0b026', 'request_id': 'req-d008460e-7326-4cbe-a82a-d36e6b642b7e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.484341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0744b97888834a0192d17859bfb0b026', 'request_id': 'req-d008460e-7326-4cbe-a82a-d36e6b642b7e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.494938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0744b97888834a0192d17859bfb0b026', 'request_id': 'req-d008460e-7326-4cbe-a82a-d36e6b642b7e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.508370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] The token cache is being invalidate because project 0744b97888834a0192d17859bfb0b026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:21.508572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.509386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.511123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1029/2071] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:21 2022] DELETE /identity/v3/projects/0744b97888834a0192d17859bfb0b026 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:21.516003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:21.518053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:21.537010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e5b74-1132-4867-b3b9-97c2ac257cbe admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:21.581832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:21.583477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:21.620423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:21.621327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:21.621738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:21.622123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] PATH_INFO: `/v3/users/35cf9e103daa47818a7e3e58356f06f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:21.623487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cf9e103daa47818a7e3e58356f06f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:21.625701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:21.674492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008460e-7326-4cbe-a82a-d36e6b642b7e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:21.679491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:21.680371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:21.680651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:21.681092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] PATH_INFO: `/v3/users/3d8e948ae270457a8a9b6197f6a02394` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:21.682617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8e948ae270457a8a9b6197f6a02394)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:21.684831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cf9e103daa47818a7e3e58356f06f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.685162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:21.697918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cf9e103daa47818a7e3e58356f06f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.706035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cf9e103daa47818a7e3e58356f06f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.707118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cf9e103daa47818a7e3e58356f06f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.717744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cf9e103daa47818a7e3e58356f06f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.729329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1043/2072] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:21 2022] DELETE /identity/v3/users/35cf9e103daa47818a7e3e58356f06f6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:21.756674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8e948ae270457a8a9b6197f6a02394'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.797958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8e948ae270457a8a9b6197f6a02394'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.798990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8e948ae270457a8a9b6197f6a02394'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.821630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8e948ae270457a8a9b6197f6a02394'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.822571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8e948ae270457a8a9b6197f6a02394'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:21.850582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1030/2073] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:21 2022] DELETE /identity/v3/users/3d8e948ae270457a8a9b6197f6a02394 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:22.171783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.173335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.210768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.212297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.271056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0a07-9783-4e02-bcc9-04a36c43eb89 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.297246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3a8f9-5c88-4248-baaf-86677e775113 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.301941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.302796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.303078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.303409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] PATH_INFO: `/v3/projects/96ac52de89f14d7995335a0d2c06ed8c` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.304590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ac52de89f14d7995335a0d2c06ed8c)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.306586 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.326396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.327261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.327544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.327818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] PATH_INFO: `/v3/projects/d0d644d0b20c47df99f7b9fdcfc5db82` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.328993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d644d0b20c47df99f7b9fdcfc5db82)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.330932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.353333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ac52de89f14d7995335a0d2c06ed8c', 'request_id': 'req-a9de8cf6-3e44-4285-9f1e-193244430d0d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.359246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ac52de89f14d7995335a0d2c06ed8c', 'request_id': 'req-a9de8cf6-3e44-4285-9f1e-193244430d0d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.366395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ac52de89f14d7995335a0d2c06ed8c', 'request_id': 'req-a9de8cf6-3e44-4285-9f1e-193244430d0d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.376783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d644d0b20c47df99f7b9fdcfc5db82', 'request_id': 'req-d47d5f6f-ca10-4f08-8a09-f6326270866c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.377978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] The token cache is being invalidate because project 96ac52de89f14d7995335a0d2c06ed8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:22.378267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.378907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a9de8cf6-3e44-4285-9f1e-193244430d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.380551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1031/2074] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:22 2022] DELETE /identity/v3/projects/96ac52de89f14d7995335a0d2c06ed8c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:22.382329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d644d0b20c47df99f7b9fdcfc5db82', 'request_id': 'req-d47d5f6f-ca10-4f08-8a09-f6326270866c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.386514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4127-9709-4b10-b8ff-406fa5093d45 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.386907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4127-9709-4b10-b8ff-406fa5093d45 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.387756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a4127-9709-4b10-b8ff-406fa5093d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.391678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d644d0b20c47df99f7b9fdcfc5db82', 'request_id': 'req-d47d5f6f-ca10-4f08-8a09-f6326270866c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.402686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] The token cache is being invalidate because project d0d644d0b20c47df99f7b9fdcfc5db82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:22.403452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.404119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d47d5f6f-ca10-4f08-8a09-f6326270866c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:22.405710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1044/2075] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:22 2022] DELETE /identity/v3/projects/d0d644d0b20c47df99f7b9fdcfc5db82 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:22.406301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-728a4127-9709-4b10-b8ff-406fa5093d45 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:22.407693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-728a4127-9709-4b10-b8ff-406fa5093d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.411401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de092-7723-4d37-afe8-59f067b2a5ce None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.411690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de092-7723-4d37-afe8-59f067b2a5ce None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.411965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de092-7723-4d37-afe8-59f067b2a5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.430107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9f7de092-7723-4d37-afe8-59f067b2a5ce None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:22.431286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9f7de092-7723-4d37-afe8-59f067b2a5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.466270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1032/2076] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:22.473881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50799ed-a3ad-400a-96a8-ce6720b92611 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.474173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50799ed-a3ad-400a-96a8-ce6720b92611 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.474451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50799ed-a3ad-400a-96a8-ce6720b92611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.489788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1045/2077] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:22.492519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d50799ed-a3ad-400a-96a8-ce6720b92611 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:22.493739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d50799ed-a3ad-400a-96a8-ce6720b92611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.498044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10793-b5b7-42f8-bd8c-c1b9fcbebf87 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.498339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10793-b5b7-42f8-bd8c-c1b9fcbebf87 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.498616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10793-b5b7-42f8-bd8c-c1b9fcbebf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.501631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1033/2078] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:22.505363 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50799ed-a3ad-400a-96a8-ce6720b92611 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.514607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50799ed-a3ad-400a-96a8-ce6720b92611 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.517329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-63e10793-b5b7-42f8-bd8c-c1b9fcbebf87 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:22.518553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-63e10793-b5b7-42f8-bd8c-c1b9fcbebf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.519230 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.519869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.520149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.520424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.521140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:22.521443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.523090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.526518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1046/2079] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:22.531224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10793-b5b7-42f8-bd8c-c1b9fcbebf87 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.540674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1034/2080] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:22.540833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10793-b5b7-42f8-bd8c-c1b9fcbebf87 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.541620 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.545168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.545856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.546146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.546426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.547159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:22.547533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.549092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.551428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35537df3-1b86-4423-99b5-05be5d48fe33 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.555888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ace52-34a9-4de4-aa47-17790fed30c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.556511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ace52-34a9-4de4-aa47-17790fed30c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.556795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ace52-34a9-4de4-aa47-17790fed30c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.557072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ace52-34a9-4de4-aa47-17790fed30c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.557774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ace52-34a9-4de4-aa47-17790fed30c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.559674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ace52-34a9-4de4-aa47-17790fed30c9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.563729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1047/2081] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:39:22.564675 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.574059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6667d-07bf-43e8-ae2b-4a775b1e5241 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.579619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804592d-4012-428d-9fd3-e19f12a9b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.580259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804592d-4012-428d-9fd3-e19f12a9b623 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.580545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804592d-4012-428d-9fd3-e19f12a9b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.580821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804592d-4012-428d-9fd3-e19f12a9b623 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.581500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804592d-4012-428d-9fd3-e19f12a9b623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.583427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804592d-4012-428d-9fd3-e19f12a9b623 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.585900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1035/2082] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:22.589840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ace52-34a9-4de4-aa47-17790fed30c9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.612152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1048/2083] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:22.614469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804592d-4012-428d-9fd3-e19f12a9b623 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.653504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ace52-34a9-4de4-aa47-17790fed30c9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.673446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804592d-4012-428d-9fd3-e19f12a9b623 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.678252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b09367-e6dc-4266-b020-d86c4aab09c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.678945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b09367-e6dc-4266-b020-d86c4aab09c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.679235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b09367-e6dc-4266-b020-d86c4aab09c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.679516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b09367-e6dc-4266-b020-d86c4aab09c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.680203 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b09367-e6dc-4266-b020-d86c4aab09c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.682225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b09367-e6dc-4266-b020-d86c4aab09c4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.702731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1049/2084] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:22.706413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b09367-e6dc-4266-b020-d86c4aab09c4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.707867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeacff-6c8f-4a5e-9b5f-bd960db139c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.708542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeacff-6c8f-4a5e-9b5f-bd960db139c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.708831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeacff-6c8f-4a5e-9b5f-bd960db139c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.709138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeacff-6c8f-4a5e-9b5f-bd960db139c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.709877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeacff-6c8f-4a5e-9b5f-bd960db139c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.711797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeacff-6c8f-4a5e-9b5f-bd960db139c3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.716765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b09367-e6dc-4266-b020-d86c4aab09c4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.721344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2eae-3be2-4c11-a398-d7a78d48e88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.722019 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2eae-3be2-4c11-a398-d7a78d48e88b admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.722335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2eae-3be2-4c11-a398-d7a78d48e88b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.722703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2eae-3be2-4c11-a398-d7a78d48e88b admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.723423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a2eae-3be2-4c11-a398-d7a78d48e88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.725362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a2eae-3be2-4c11-a398-d7a78d48e88b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.735764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1036/2085] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:22.735989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1050/2086] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:22.736995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeacff-6c8f-4a5e-9b5f-bd960db139c3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.738908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2eae-3be2-4c11-a398-d7a78d48e88b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.746257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeacff-6c8f-4a5e-9b5f-bd960db139c3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.748739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2eae-3be2-4c11-a398-d7a78d48e88b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.750941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4b02-af41-4c95-9c15-85fbbaeff9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.751574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4b02-af41-4c95-9c15-85fbbaeff9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.751856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4b02-af41-4c95-9c15-85fbbaeff9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.752131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a4b02-af41-4c95-9c15-85fbbaeff9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.752879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a4b02-af41-4c95-9c15-85fbbaeff9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.753480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e470c75-a743-4bae-a716-6502869b6f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.754205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470c75-a743-4bae-a716-6502869b6f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.754480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a4b02-af41-4c95-9c15-85fbbaeff9e0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.754578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470c75-a743-4bae-a716-6502869b6f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.754809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e470c75-a743-4bae-a716-6502869b6f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.755526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e470c75-a743-4bae-a716-6502869b6f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.757091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e470c75-a743-4bae-a716-6502869b6f6b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.764674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1037/2087] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:22.768717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4b02-af41-4c95-9c15-85fbbaeff9e0 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.770267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1051/2088] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:22.773926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e470c75-a743-4bae-a716-6502869b6f6b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.778900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a4b02-af41-4c95-9c15-85fbbaeff9e0 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.783421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f06626-db28-45e7-92ba-023f49dcf53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.783856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e470c75-a743-4bae-a716-6502869b6f6b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.784059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06626-db28-45e7-92ba-023f49dcf53c admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.784343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06626-db28-45e7-92ba-023f49dcf53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.784615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f06626-db28-45e7-92ba-023f49dcf53c admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.785351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f06626-db28-45e7-92ba-023f49dcf53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.786952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f06626-db28-45e7-92ba-023f49dcf53c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.788392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba25c66-3bc1-46cf-b032-3be5ea0f8ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.789237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25c66-3bc1-46cf-b032-3be5ea0f8ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.789513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25c66-3bc1-46cf-b032-3be5ea0f8ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.789878 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25c66-3bc1-46cf-b032-3be5ea0f8ec8 admin admin] PATH_INFO: `/v3/projects/60f53a86e6724ca1bd063d85eaa3c6b2/users/09418379357746df911dd48746e14dd5/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.797326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1038/2089] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:22.801376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f06626-db28-45e7-92ba-023f49dcf53c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.804084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba25c66-3bc1-46cf-b032-3be5ea0f8ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f53a86e6724ca1bd063d85eaa3c6b2, user_id=09418379357746df911dd48746e14dd5, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.807133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba25c66-3bc1-46cf-b032-3be5ea0f8ec8 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.810792 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f06626-db28-45e7-92ba-023f49dcf53c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:22.815793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f2e53-422d-4dd0-87c3-7ea50f76e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:22.816911 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f2e53-422d-4dd0-87c3-7ea50f76e77d admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.817191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f2e53-422d-4dd0-87c3-7ea50f76e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.817483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f2e53-422d-4dd0-87c3-7ea50f76e77d admin admin] PATH_INFO: `/v3/projects/9750cb9309234cb1b63343050ba700f9/users/ad7271d8e9424bb7ad8ce1143fc71de9/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.820833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1052/2090] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:22 2022] PUT /identity/v3/projects/60f53a86e6724ca1bd063d85eaa3c6b2/users/09418379357746df911dd48746e14dd5/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:22.832764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f2e53-422d-4dd0-87c3-7ea50f76e77d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9750cb9309234cb1b63343050ba700f9, user_id=ad7271d8e9424bb7ad8ce1143fc71de9, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:22.833322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb331f-8cca-4ad8-96d7-a124b26a2c2c None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.833636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb331f-8cca-4ad8-96d7-a124b26a2c2c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.833909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb331f-8cca-4ad8-96d7-a124b26a2c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.835572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f2e53-422d-4dd0-87c3-7ea50f76e77d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:22.849125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1039/2091] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:22 2022] PUT /identity/v3/projects/9750cb9309234cb1b63343050ba700f9/users/ad7271d8e9424bb7ad8ce1143fc71de9/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:22.854107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53f7f-64a3-4bbd-98f9-b1b04ea7078b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:22.854396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53f7f-64a3-4bbd-98f9-b1b04ea7078b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:22.854672 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53f7f-64a3-4bbd-98f9-b1b04ea7078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:22.860649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e7cb331f-8cca-4ad8-96d7-a124b26a2c2c None None] MFA Rules not processed for user `09418379357746df911dd48746e14dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:22.861889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e7cb331f-8cca-4ad8-96d7-a124b26a2c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.871008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-80f53f7f-64a3-4bbd-98f9-b1b04ea7078b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:22.872671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-80f53f7f-64a3-4bbd-98f9-b1b04ea7078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.923620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1053/2092] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:22.928648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1040/2093] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:22.935683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb331f-8cca-4ad8-96d7-a124b26a2c2c None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.937156 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e7cb331f-8cca-4ad8-96d7-a124b26a2c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.938912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53f7f-64a3-4bbd-98f9-b1b04ea7078b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:22.940714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-80f53f7f-64a3-4bbd-98f9-b1b04ea7078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:22.998671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53f7f-64a3-4bbd-98f9-b1b04ea7078b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:23.004410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:23.005065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:23.005352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:23.005664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:23.008072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb331f-8cca-4ad8-96d7-a124b26a2c2c None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:23.011700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64324243-2e50-4b53-b83a-6b6c2b22bd1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:23.012984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64324243-2e50-4b53-b83a-6b6c2b22bd1e service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:23.013265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64324243-2e50-4b53-b83a-6b6c2b22bd1e service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:23.013616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64324243-2e50-4b53-b83a-6b6c2b22bd1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:23.015414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:23.016842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:23.022050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64324243-2e50-4b53-b83a-6b6c2b22bd1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:23.023473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64324243-2e50-4b53-b83a-6b6c2b22bd1e service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:23.026112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1041/2094] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:23.028817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:23.030187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:23.032445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1054/2095] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:23.043874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e5f1e-fea9-473f-a158-8c3ec5a58db6 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:23.049138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:23.050272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:23.050738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:23.051081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] PATH_INFO: `/v3/users/aaa1bfa9e3f34a509da6933caa1aeacc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:23.052486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa1bfa9e3f34a509da6933caa1aeacc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:23.054742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:23.110785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa1bfa9e3f34a509da6933caa1aeacc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.124548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa1bfa9e3f34a509da6933caa1aeacc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.125385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa1bfa9e3f34a509da6933caa1aeacc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.133521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa1bfa9e3f34a509da6933caa1aeacc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.134307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa1bfa9e3f34a509da6933caa1aeacc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.150222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1042/2096] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:23 2022] DELETE /identity/v3/users/aaa1bfa9e3f34a509da6933caa1aeacc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:23.155257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db127a-2ea4-4151-a328-6872b9311498 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:23.155544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db127a-2ea4-4151-a328-6872b9311498 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:23.155979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db127a-2ea4-4151-a328-6872b9311498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:23.175668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d3db127a-2ea4-4151-a328-6872b9311498 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:23.177344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d3db127a-2ea4-4151-a328-6872b9311498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:23.259537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1055/2097] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:23.269144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:23.271343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:23.369281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b264e-8f69-441e-a84d-2ce2361adf45 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:23.375671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84573-60ef-4d3c-af1d-eba0b46d2f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:23.376361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84573-60ef-4d3c-af1d-eba0b46d2f60 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:23.376648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84573-60ef-4d3c-af1d-eba0b46d2f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:23.376948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84573-60ef-4d3c-af1d-eba0b46d2f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:23.391989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b84573-60ef-4d3c-af1d-eba0b46d2f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:23.393991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b84573-60ef-4d3c-af1d-eba0b46d2f60 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:23.406218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1043/2098] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:23.859043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db127a-2ea4-4151-a328-6872b9311498 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:23.860589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d3db127a-2ea4-4151-a328-6872b9311498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:23.884779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db127a-2ea4-4151-a328-6872b9311498 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:23.889901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:23.890737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:23.890952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:23.891219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] PATH_INFO: `/v3/projects/350d9c29f9ac40a6811c5f97b9b92da0` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:23.892562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350d9c29f9ac40a6811c5f97b9b92da0)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:23.894551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:23.946040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350d9c29f9ac40a6811c5f97b9b92da0', 'request_id': 'req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.952422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350d9c29f9ac40a6811c5f97b9b92da0', 'request_id': 'req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.960457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350d9c29f9ac40a6811c5f97b9b92da0', 'request_id': 'req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.973005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] The token cache is being invalidate because project 350d9c29f9ac40a6811c5f97b9b92da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:23.973354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.974383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:23.976459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1056/2099] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:23 2022] DELETE /identity/v3/projects/350d9c29f9ac40a6811c5f97b9b92da0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:23.980197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84573-60ef-4d3c-af1d-eba0b46d2f60 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:23.991383 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84573-60ef-4d3c-af1d-eba0b46d2f60 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:24.057479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:24.058641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:24.059130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:24.059570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] PATH_INFO: `/v3/users/9e29bae937de4370bd1f8730fdec3979` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:24.060821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e29bae937de4370bd1f8730fdec3979)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:24.062776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:24.119890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e29bae937de4370bd1f8730fdec3979'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.132531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e29bae937de4370bd1f8730fdec3979'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.133312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e29bae937de4370bd1f8730fdec3979'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.141998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e29bae937de4370bd1f8730fdec3979'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.142708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-472451a1-1d29-4cce-8381-ea92f64c79ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e29bae937de4370bd1f8730fdec3979'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.157599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1044/2100] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:23 2022] DELETE /identity/v3/users/9e29bae937de4370bd1f8730fdec3979 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:24.685129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:24.686683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:24.703712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8adb9-7c8c-4ca3-a881-5cac6f89a8b9 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:24.805904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:24.806811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:24.807099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:24.807378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] PATH_INFO: `/v3/projects/7bbd8f6757f54a6bb13e3a48793e9e06` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:24.810380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbd8f6757f54a6bb13e3a48793e9e06)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:24.812343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:24.868133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbd8f6757f54a6bb13e3a48793e9e06', 'request_id': 'req-225be199-368c-41b8-97be-d376e04fb33c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.874900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbd8f6757f54a6bb13e3a48793e9e06', 'request_id': 'req-225be199-368c-41b8-97be-d376e04fb33c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.882824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbd8f6757f54a6bb13e3a48793e9e06', 'request_id': 'req-225be199-368c-41b8-97be-d376e04fb33c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.899115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] The token cache is being invalidate because project 7bbd8f6757f54a6bb13e3a48793e9e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:24.899632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.900632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-225be199-368c-41b8-97be-d376e04fb33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:24.918850 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1057/2101] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:24 2022] DELETE /identity/v3/projects/7bbd8f6757f54a6bb13e3a48793e9e06 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:24.920083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885af8f6-b8fe-45db-9357-afdad8bccfed None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:24.923173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885af8f6-b8fe-45db-9357-afdad8bccfed None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:24.923475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885af8f6-b8fe-45db-9357-afdad8bccfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:24.943317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-885af8f6-b8fe-45db-9357-afdad8bccfed None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:24.944887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-885af8f6-b8fe-45db-9357-afdad8bccfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:25.034163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1045/2102] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:25.047660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034619f-1ef8-4090-81cc-2ee20713dcef None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.048245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034619f-1ef8-4090-81cc-2ee20713dcef None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.048741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034619f-1ef8-4090-81cc-2ee20713dcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.080169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0034619f-1ef8-4090-81cc-2ee20713dcef None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:25.082800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0034619f-1ef8-4090-81cc-2ee20713dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:25.097074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1058/2103] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:25.099384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885af8f6-b8fe-45db-9357-afdad8bccfed None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:25.118032 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885af8f6-b8fe-45db-9357-afdad8bccfed None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:25.123257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:25.123935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.124423 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.124707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.125448 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:25.125804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:25.127612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:25.150391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1046/2104] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:25.155357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034619f-1ef8-4090-81cc-2ee20713dcef None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:25.164807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034619f-1ef8-4090-81cc-2ee20713dcef None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:25.171245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0732de-0a88-49a8-9dad-4eaf954d798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:25.172145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0732de-0a88-49a8-9dad-4eaf954d798f admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.172635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0732de-0a88-49a8-9dad-4eaf954d798f admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.173115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0732de-0a88-49a8-9dad-4eaf954d798f admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.174060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0732de-0a88-49a8-9dad-4eaf954d798f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:25.176254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0732de-0a88-49a8-9dad-4eaf954d798f admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:25.211395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1059/2105] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:25 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:25.216674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:25.229879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df5305-3149-420a-862e-7dd988e3df7e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:25.318120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50066b57-9f65-48db-b6c6-b04fed78b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:25.319188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066b57-9f65-48db-b6c6-b04fed78b4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.319320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066b57-9f65-48db-b6c6-b04fed78b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.319692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50066b57-9f65-48db-b6c6-b04fed78b4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.320558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50066b57-9f65-48db-b6c6-b04fed78b4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:25.322621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50066b57-9f65-48db-b6c6-b04fed78b4a9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:25.349598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1047/2106] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:25 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:25.353046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0732de-0a88-49a8-9dad-4eaf954d798f admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:25.370682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0732de-0a88-49a8-9dad-4eaf954d798f admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:25.376038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b37fb5-43d5-45a9-b24d-683e39f9eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:25.376804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b37fb5-43d5-45a9-b24d-683e39f9eee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.377477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b37fb5-43d5-45a9-b24d-683e39f9eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.377861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b37fb5-43d5-45a9-b24d-683e39f9eee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.378738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b37fb5-43d5-45a9-b24d-683e39f9eee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:25.381096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b37fb5-43d5-45a9-b24d-683e39f9eee6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:25.398547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1060/2107] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:25.401286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50066b57-9f65-48db-b6c6-b04fed78b4a9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:25.413283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50066b57-9f65-48db-b6c6-b04fed78b4a9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:25.418851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b9d33-dc7c-4466-be82-2e50c39d856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:25.419676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9d33-dc7c-4466-be82-2e50c39d856e admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.420033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9d33-dc7c-4466-be82-2e50c39d856e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.420381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9d33-dc7c-4466-be82-2e50c39d856e admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.421184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b9d33-dc7c-4466-be82-2e50c39d856e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:25.422935 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b9d33-dc7c-4466-be82-2e50c39d856e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:25.437018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1048/2108] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:25.440144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b37fb5-43d5-45a9-b24d-683e39f9eee6 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:25.460783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b37fb5-43d5-45a9-b24d-683e39f9eee6 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:25.466546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:25.467503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.467787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.468059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] PATH_INFO: `/v3/projects/bf5f79f1438d4f118871d811c4499eed/users/c74a02c60df34b5c9336f908653a5490/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.499820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5f79f1438d4f118871d811c4499eed, user_id=c74a02c60df34b5c9336f908653a5490, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:25.504266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:25.533600 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1061/2109] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:25 2022] PUT /identity/v3/projects/bf5f79f1438d4f118871d811c4499eed/users/c74a02c60df34b5c9336f908653a5490/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:25.552177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f30aa4-4bb9-4fa4-82e1-bf6849cd59d4 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.552468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f30aa4-4bb9-4fa4-82e1-bf6849cd59d4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.552759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f30aa4-4bb9-4fa4-82e1-bf6849cd59d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.587099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-83f30aa4-4bb9-4fa4-82e1-bf6849cd59d4 None None] MFA Rules not processed for user `c74a02c60df34b5c9336f908653a5490`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:25.588540 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-83f30aa4-4bb9-4fa4-82e1-bf6849cd59d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:25.669454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1049/2110] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:25.677029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:25.678957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:25.747444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f117bb-4128-4a9e-a8c6-612bc4261946 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:25.751089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:25.751861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:25.752213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:25.752566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:25.761474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:25.763504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:25.772973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1062/2111] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:28.220465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ae4a-bae3-494e-a79e-dc3aca66742e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:28.221618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ae4a-bae3-494e-a79e-dc3aca66742e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:28.222126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3ae4a-bae3-494e-a79e-dc3aca66742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:28.258157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f3f3ae4a-bae3-494e-a79e-dc3aca66742e None None] MFA Rules not processed for user `ad7271d8e9424bb7ad8ce1143fc71de9`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:28.260250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f3f3ae4a-bae3-494e-a79e-dc3aca66742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:28.382181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1050/2112] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:28.396757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:28.402678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:28.567453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5359-b444-4f99-aacd-c37395ddefe3 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:28.584958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62c7db-d39c-46da-b9fe-292cc9d637d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:28.585832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62c7db-d39c-46da-b9fe-292cc9d637d7 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:28.586080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62c7db-d39c-46da-b9fe-292cc9d637d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:28.586363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62c7db-d39c-46da-b9fe-292cc9d637d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:28.605084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62c7db-d39c-46da-b9fe-292cc9d637d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:28.608481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62c7db-d39c-46da-b9fe-292cc9d637d7 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:28.622899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1063/2113] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:30.405069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3ae4a-bae3-494e-a79e-dc3aca66742e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:30.407491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f3f3ae4a-bae3-494e-a79e-dc3aca66742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:30.492131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3ae4a-bae3-494e-a79e-dc3aca66742e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:30.497195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:30.498115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:30.498403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:30.498675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] PATH_INFO: `/v3/users/327b20c48429419c836feae197034b32` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:30.500050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327b20c48429419c836feae197034b32)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:30.502090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:30.554539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327b20c48429419c836feae197034b32'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:30.569468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327b20c48429419c836feae197034b32'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:30.570521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327b20c48429419c836feae197034b32'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:30.579005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327b20c48429419c836feae197034b32'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:30.580515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e3ecedaf-69a7-41bd-b3c0-0f5354448c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327b20c48429419c836feae197034b32'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:30.600822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1051/2114] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:30 2022] DELETE /identity/v3/users/327b20c48429419c836feae197034b32 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:30.883933 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62c7db-d39c-46da-b9fe-292cc9d637d7 service nova] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:30.899723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62c7db-d39c-46da-b9fe-292cc9d637d7 service nova] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:30.990362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b71dc-946e-4811-ba5b-992662a3c678 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:30.990643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b71dc-946e-4811-ba5b-992662a3c678 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:30.990938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b71dc-946e-4811-ba5b-992662a3c678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:31.011450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:31.012378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:31.012657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:31.012927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] PATH_INFO: `/v3/projects/3d6974a3465f4096ab62e7225f26a001` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:31.015238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6974a3465f4096ab62e7225f26a001)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:31.021016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:31.025474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-590b71dc-946e-4811-ba5b-992662a3c678 None None] MFA Rules not processed for user `ad7271d8e9424bb7ad8ce1143fc71de9`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:31.026743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-590b71dc-946e-4811-ba5b-992662a3c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:31.110985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6974a3465f4096ab62e7225f26a001', 'request_id': 'req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.118774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6974a3465f4096ab62e7225f26a001', 'request_id': 'req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.124234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1052/2115] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:31.130548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6974a3465f4096ab62e7225f26a001', 'request_id': 'req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.144412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] The token cache is being invalidate because project 3d6974a3465f4096ab62e7225f26a001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:31.144619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.145322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.147246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1064/2116] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:30 2022] DELETE /identity/v3/projects/3d6974a3465f4096ab62e7225f26a001 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:31.151607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b71dc-946e-4811-ba5b-992662a3c678 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:31.153896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-590b71dc-946e-4811-ba5b-992662a3c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:31.169198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b71dc-946e-4811-ba5b-992662a3c678 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:31.255211 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:31.256264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:31.256564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:31.256906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] PATH_INFO: `/v3/users/1a15b966171b4885a909034d6c6026c8` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:31.259710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a15b966171b4885a909034d6c6026c8)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:31.265316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:31.345341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a15b966171b4885a909034d6c6026c8'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.360263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a15b966171b4885a909034d6c6026c8'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.361693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a15b966171b4885a909034d6c6026c8'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.370446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a15b966171b4885a909034d6c6026c8'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.371041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c49275d6-fc14-4b18-a499-4b0bd36b27dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a15b966171b4885a909034d6c6026c8'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.405362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1053/2117] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:31 2022] DELETE /identity/v3/users/1a15b966171b4885a909034d6c6026c8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:31.638957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:31.642354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:31.669677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9fd57-84cd-43da-9b63-1595e1b0ba8e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:31.785105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:31.786017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:31.786298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:31.786566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] PATH_INFO: `/v3/projects/d50a39ef05a84ef5aa3c634250c6c24a` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:31.787768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50a39ef05a84ef5aa3c634250c6c24a)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:31.790818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:31.847621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50a39ef05a84ef5aa3c634250c6c24a', 'request_id': 'req-bc064c68-6fff-4381-938c-d3088cbfd639'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.853438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50a39ef05a84ef5aa3c634250c6c24a', 'request_id': 'req-bc064c68-6fff-4381-938c-d3088cbfd639'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.863534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50a39ef05a84ef5aa3c634250c6c24a', 'request_id': 'req-bc064c68-6fff-4381-938c-d3088cbfd639'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.875520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] The token cache is being invalidate because project d50a39ef05a84ef5aa3c634250c6c24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:31.875923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.876672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bc064c68-6fff-4381-938c-d3088cbfd639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:31.878707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1065/2118] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:31 2022] DELETE /identity/v3/projects/d50a39ef05a84ef5aa3c634250c6c24a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:31.883315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d7a6-c819-440d-aca8-176ca2c546a8 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:31.883601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d7a6-c819-440d-aca8-176ca2c546a8 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:31.883880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d7a6-c819-440d-aca8-176ca2c546a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:31.904205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d816d7a6-c819-440d-aca8-176ca2c546a8 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:31.905434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d816d7a6-c819-440d-aca8-176ca2c546a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:31.998891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1054/2119] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:32.002364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a3d0-16a0-4652-99c7-a8738754e77c None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.002866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a3d0-16a0-4652-99c7-a8738754e77c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.003066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a3d0-16a0-4652-99c7-a8738754e77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.024738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-85a7a3d0-16a0-4652-99c7-a8738754e77c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:32.026461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-85a7a3d0-16a0-4652-99c7-a8738754e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:32.039712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1066/2120] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:32.044434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816d7a6-c819-440d-aca8-176ca2c546a8 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.054892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816d7a6-c819-440d-aca8-176ca2c546a8 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.060760 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.061426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.061744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.062020 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.062770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:32.063193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:32.064727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:32.082974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1055/2121] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:32.088604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a3d0-16a0-4652-99c7-a8738754e77c None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.100050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a3d0-16a0-4652-99c7-a8738754e77c None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.107989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7c88-99c3-4d78-aa19-e685c69c1d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.108681 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7c88-99c3-4d78-aa19-e685c69c1d8e admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.109034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7c88-99c3-4d78-aa19-e685c69c1d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.109366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c7c88-99c3-4d78-aa19-e685c69c1d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.110401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c7c88-99c3-4d78-aa19-e685c69c1d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:32.113144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c7c88-99c3-4d78-aa19-e685c69c1d8e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:32.158031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1067/2122] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:32 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:32.162687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.175997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc0b25-b430-458f-a3f6-06b0c5c926ee admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.258265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.259058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.259480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.260138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.261338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:32.264263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:32.298643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1056/2123] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:32 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:32.303697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7c88-99c3-4d78-aa19-e685c69c1d8e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.315480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c7c88-99c3-4d78-aa19-e685c69c1d8e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.323741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49de082-cc33-48ef-88e6-55fdb839d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.325175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de082-cc33-48ef-88e6-55fdb839d170 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.325797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de082-cc33-48ef-88e6-55fdb839d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.326602 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49de082-cc33-48ef-88e6-55fdb839d170 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.328035 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49de082-cc33-48ef-88e6-55fdb839d170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:32.330863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49de082-cc33-48ef-88e6-55fdb839d170 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:32.349215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.352008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:32.354346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1068/2124] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:32.358440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49de082-cc33-48ef-88e6-55fdb839d170 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.371161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a0509-c9c7-4ef2-949a-5f61b8001440 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.373724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49de082-cc33-48ef-88e6-55fdb839d170 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.377445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.379053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.379328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.379651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] PATH_INFO: `/v3/users/c74a02c60df34b5c9336f908653a5490` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.381201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74a02c60df34b5c9336f908653a5490)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:32.383004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa55f-2797-465a-81f7-fa454741b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.383568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa55f-2797-465a-81f7-fa454741b066 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.383911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa55f-2797-465a-81f7-fa454741b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.384046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:32.384502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa55f-2797-465a-81f7-fa454741b066 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.385708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aa55f-2797-465a-81f7-fa454741b066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:32.392391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aa55f-2797-465a-81f7-fa454741b066 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:32.407105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1069/2125] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:32.411160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa55f-2797-465a-81f7-fa454741b066 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.425376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa55f-2797-465a-81f7-fa454741b066 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.436394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353618-3e08-4065-91f6-903a325752d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.438105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353618-3e08-4065-91f6-903a325752d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.438467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353618-3e08-4065-91f6-903a325752d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.439419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353618-3e08-4065-91f6-903a325752d4 admin admin] PATH_INFO: `/v3/projects/b3244a49bd1c47f8bf2a0303e7089eaf/users/8bf94336c24d42688cd479216642197c/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.469159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353618-3e08-4065-91f6-903a325752d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3244a49bd1c47f8bf2a0303e7089eaf, user_id=8bf94336c24d42688cd479216642197c, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:32.472881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353618-3e08-4065-91f6-903a325752d4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:32.511616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1070/2126] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:32 2022] PUT /identity/v3/projects/b3244a49bd1c47f8bf2a0303e7089eaf/users/8bf94336c24d42688cd479216642197c/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:32.516486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74a02c60df34b5c9336f908653a5490'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:32.523363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda27d7-cb0e-417e-bd9f-81fe8f7c2b89 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.523654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda27d7-cb0e-417e-bd9f-81fe8f7c2b89 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.523965 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda27d7-cb0e-417e-bd9f-81fe8f7c2b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.554949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74a02c60df34b5c9336f908653a5490'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:32.555889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74a02c60df34b5c9336f908653a5490'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:32.576715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8fda27d7-cb0e-417e-bd9f-81fe8f7c2b89 None None] MFA Rules not processed for user `8bf94336c24d42688cd479216642197c`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:32.579542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8fda27d7-cb0e-417e-bd9f-81fe8f7c2b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:32.603727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74a02c60df34b5c9336f908653a5490'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:32.606400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c1cd3578-dbfb-4aff-a455-4bfaf8fe348f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74a02c60df34b5c9336f908653a5490'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:32.647274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1057/2127] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:32 2022] DELETE /identity/v3/users/c74a02c60df34b5c9336f908653a5490 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:32.647274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa995dc-0774-4f91-9420-4a3eb3ef4328 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.647274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa995dc-0774-4f91-9420-4a3eb3ef4328 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.647274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa995dc-0774-4f91-9420-4a3eb3ef4328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.681331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-aaa995dc-0774-4f91-9420-4a3eb3ef4328 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:32.688118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-aaa995dc-0774-4f91-9420-4a3eb3ef4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:32.743750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1071/2128] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:32.777859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda27d7-cb0e-417e-bd9f-81fe8f7c2b89 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.780241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8fda27d7-cb0e-417e-bd9f-81fe8f7c2b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:32.846459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1058/2129] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:32.860983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa995dc-0774-4f91-9420-4a3eb3ef4328 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:32.863764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-aaa995dc-0774-4f91-9420-4a3eb3ef4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:32.867849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda27d7-cb0e-417e-bd9f-81fe8f7c2b89 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.928725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d87610-c735-4a91-863f-2a015a32d7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.929591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d87610-c735-4a91-863f-2a015a32d7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.929905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d87610-c735-4a91-863f-2a015a32d7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.930241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d87610-c735-4a91-863f-2a015a32d7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:32.955970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa995dc-0774-4f91-9420-4a3eb3ef4328 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:32.964336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:32.986580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:32.987415 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:32.988355 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.024588 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:33.028457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:33.045927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d87610-c735-4a91-863f-2a015a32d7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:33.050104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d87610-c735-4a91-863f-2a015a32d7b0 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:33.052809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1059/2130] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:33.067024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1072/2131] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:33.087812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:33.089489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:33.107460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c46fd4-aa41-4519-8b18-fe003657d8bb service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:33.114447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:33.115533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:33.115821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:33.116295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] PATH_INFO: `/v3/users/8bf94336c24d42688cd479216642197c` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.118529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf94336c24d42688cd479216642197c)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:33.121912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:33.256493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf94336c24d42688cd479216642197c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.281018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf94336c24d42688cd479216642197c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.282372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf94336c24d42688cd479216642197c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.291690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf94336c24d42688cd479216642197c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.293863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf94336c24d42688cd479216642197c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.316459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1060/2132] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:33 2022] DELETE /identity/v3/users/8bf94336c24d42688cd479216642197c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:33.319534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80ee7-9624-4a26-8d81-ba8148ff0678 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:33.319961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80ee7-9624-4a26-8d81-ba8148ff0678 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:33.320362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa80ee7-9624-4a26-8d81-ba8148ff0678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.341445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-2aa80ee7-9624-4a26-8d81-ba8148ff0678 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:33.342711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2aa80ee7-9624-4a26-8d81-ba8148ff0678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:33.444092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1073/2133] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:33.455569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:33.457250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:33.529728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7770faa-5b4f-49c7-8fc9-2c286f3deb0d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:33.535683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61775f5-305d-4331-abd1-44bb3bb02130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:33.536962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61775f5-305d-4331-abd1-44bb3bb02130 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:33.536962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61775f5-305d-4331-abd1-44bb3bb02130 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:33.537189 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61775f5-305d-4331-abd1-44bb3bb02130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.548371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61775f5-305d-4331-abd1-44bb3bb02130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:33.550024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61775f5-305d-4331-abd1-44bb3bb02130 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:33.559926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1061/2134] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:33.621753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa80ee7-9624-4a26-8d81-ba8148ff0678 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:33.623215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2aa80ee7-9624-4a26-8d81-ba8148ff0678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:33.636182 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa80ee7-9624-4a26-8d81-ba8148ff0678 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:33.641172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:33.642077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:33.642565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:33.642677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] PATH_INFO: `/v3/projects/bf5f79f1438d4f118871d811c4499eed` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.644618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5f79f1438d4f118871d811c4499eed)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:33.646955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:33.721642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5f79f1438d4f118871d811c4499eed', 'request_id': 'req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.729507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5f79f1438d4f118871d811c4499eed', 'request_id': 'req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.739730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5f79f1438d4f118871d811c4499eed', 'request_id': 'req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.751708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] The token cache is being invalidate because project bf5f79f1438d4f118871d811c4499eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:33.751992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.752656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6053a1d2-f442-4e3f-b5a6-5f07db9a76d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:33.754259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1074/2135] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:33 2022] DELETE /identity/v3/projects/bf5f79f1438d4f118871d811c4499eed => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:33.759025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f73d57-7b6e-448b-b7c1-b33a73d4390f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:33.759318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f73d57-7b6e-448b-b7c1-b33a73d4390f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:33.759599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f73d57-7b6e-448b-b7c1-b33a73d4390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.779727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-50f73d57-7b6e-448b-b7c1-b33a73d4390f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:33.781749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-50f73d57-7b6e-448b-b7c1-b33a73d4390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:33.864883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1062/2136] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:33.872738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a7ed-377e-485c-8b6c-10f108fec20d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:33.873028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a7ed-377e-485c-8b6c-10f108fec20d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:33.873329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a7ed-377e-485c-8b6c-10f108fec20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.896945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-dc98a7ed-377e-485c-8b6c-10f108fec20d None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:33.898794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-dc98a7ed-377e-485c-8b6c-10f108fec20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:33.907800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1075/2137] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:33.912067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f73d57-7b6e-448b-b7c1-b33a73d4390f None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:33.920109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a7ed-377e-485c-8b6c-10f108fec20d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:33.924285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f73d57-7b6e-448b-b7c1-b33a73d4390f None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:33.925929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-dc98a7ed-377e-485c-8b6c-10f108fec20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:33.938895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:33.939861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:33.940649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:33.940954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a7ed-377e-485c-8b6c-10f108fec20d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:33.942696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.944298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:33.944841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:33.946940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:33.947555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:33.948694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:33.948907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:33.949829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] PATH_INFO: `/v3/projects/b3244a49bd1c47f8bf2a0303e7089eaf` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:33.951247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3244a49bd1c47f8bf2a0303e7089eaf)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:33.953795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:33.980044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1063/2138] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:39:33.981191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:33.992932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce844d7-8c7b-4712-8a05-76b76947b466 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:33.998697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5845-9f9b-4dfe-95f3-2f6742513966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.000246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5845-9f9b-4dfe-95f3-2f6742513966 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.000603 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5845-9f9b-4dfe-95f3-2f6742513966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.000942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce5845-9f9b-4dfe-95f3-2f6742513966 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.001899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce5845-9f9b-4dfe-95f3-2f6742513966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.004207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce5845-9f9b-4dfe-95f3-2f6742513966 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.009752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3244a49bd1c47f8bf2a0303e7089eaf', 'request_id': 'req-9e8ed84b-322c-4063-877c-fa9275dd8c83'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:34.017358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3244a49bd1c47f8bf2a0303e7089eaf', 'request_id': 'req-9e8ed84b-322c-4063-877c-fa9275dd8c83'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:34.030002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3244a49bd1c47f8bf2a0303e7089eaf', 'request_id': 'req-9e8ed84b-322c-4063-877c-fa9275dd8c83'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:34.037570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1064/2139] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:33 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:34.041728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5845-9f9b-4dfe-95f3-2f6742513966 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.043360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] The token cache is being invalidate because project b3244a49bd1c47f8bf2a0303e7089eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:34.043661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:34.044329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9e8ed84b-322c-4063-877c-fa9275dd8c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:34.045961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1076/2140] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:33 2022] DELETE /identity/v3/projects/b3244a49bd1c47f8bf2a0303e7089eaf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:34.054172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b152-fdf4-4e39-aaa1-efbf02a57672 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.054463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b152-fdf4-4e39-aaa1-efbf02a57672 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.054912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629b152-fdf4-4e39-aaa1-efbf02a57672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.078064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c629b152-fdf4-4e39-aaa1-efbf02a57672 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:34.079633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c629b152-fdf4-4e39-aaa1-efbf02a57672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:34.132692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce5845-9f9b-4dfe-95f3-2f6742513966 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.140889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.142325 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.143056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.143565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.144571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.148082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.158435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1077/2141] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:34.168419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29410e0-5aee-42b0-97a6-e5d027d7c14e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.169992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29410e0-5aee-42b0-97a6-e5d027d7c14e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.171077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29410e0-5aee-42b0-97a6-e5d027d7c14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.177571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1065/2142] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:34.181166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.186722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:34.195793 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a29410e0-5aee-42b0-97a6-e5d027d7c14e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:34.196977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a29410e0-5aee-42b0-97a6-e5d027d7c14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:34.206324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f9b98-1846-4234-8c41-ed10356a0232 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.210523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1078/2143] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:34.215632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29410e0-5aee-42b0-97a6-e5d027d7c14e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.219395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af02c2-7bd6-4de7-a836-f69a79560066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.220064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af02c2-7bd6-4de7-a836-f69a79560066 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.220340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af02c2-7bd6-4de7-a836-f69a79560066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.223740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af02c2-7bd6-4de7-a836-f69a79560066 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.224005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af02c2-7bd6-4de7-a836-f69a79560066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.225703 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af02c2-7bd6-4de7-a836-f69a79560066 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.235143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29410e0-5aee-42b0-97a6-e5d027d7c14e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.240221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1066/2144] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:34.241358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af02c2-7bd6-4de7-a836-f69a79560066 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.250358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.251056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.251329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.251610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.252355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:34.252668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.254328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.254545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af02c2-7bd6-4de7-a836-f69a79560066 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.266208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce28b-9d51-4bbf-844f-a564353cc7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.267343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce28b-9d51-4bbf-844f-a564353cc7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.267627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce28b-9d51-4bbf-844f-a564353cc7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.267899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ce28b-9d51-4bbf-844f-a564353cc7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.268688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ce28b-9d51-4bbf-844f-a564353cc7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.270381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ce28b-9d51-4bbf-844f-a564353cc7d1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.282501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1079/2145] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:34.286413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.294287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1067/2146] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:34.299083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce28b-9d51-4bbf-844f-a564353cc7d1 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.300812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e27bcd-9d9e-4c1a-a280-f5bf027fccf7 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.307042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de50a8-e4eb-44c7-bd36-9fabd48a2e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.307910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de50a8-e4eb-44c7-bd36-9fabd48a2e1a admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.308360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de50a8-e4eb-44c7-bd36-9fabd48a2e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.309323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de50a8-e4eb-44c7-bd36-9fabd48a2e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.310341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de50a8-e4eb-44c7-bd36-9fabd48a2e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.312542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de50a8-e4eb-44c7-bd36-9fabd48a2e1a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.319930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ce28b-9d51-4bbf-844f-a564353cc7d1 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.325950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810777-9008-4f73-b466-e3a3b2cce85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.326992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810777-9008-4f73-b466-e3a3b2cce85b admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.327400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810777-9008-4f73-b466-e3a3b2cce85b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.327766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810777-9008-4f73-b466-e3a3b2cce85b admin admin] PATH_INFO: `/v3/projects/d8489c3acbb541d68846ca2ab65b7fc0/users/52a4de2a2ff2440589b53a097a2a6bd2/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.346480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810777-9008-4f73-b466-e3a3b2cce85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8489c3acbb541d68846ca2ab65b7fc0, user_id=52a4de2a2ff2440589b53a097a2a6bd2, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.351361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1080/2147] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:34.351507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810777-9008-4f73-b466-e3a3b2cce85b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.352773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de50a8-e4eb-44c7-bd36-9fabd48a2e1a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.390560 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1068/2148] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:34 2022] PUT /identity/v3/projects/d8489c3acbb541d68846ca2ab65b7fc0/users/52a4de2a2ff2440589b53a097a2a6bd2/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:34.401485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92efc0-51bf-45d1-b880-59498742b454 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.401821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92efc0-51bf-45d1-b880-59498742b454 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.402102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92efc0-51bf-45d1-b880-59498742b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.460221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3d92efc0-51bf-45d1-b880-59498742b454 None None] MFA Rules not processed for user `52a4de2a2ff2440589b53a097a2a6bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:34.461614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3d92efc0-51bf-45d1-b880-59498742b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:34.488715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de50a8-e4eb-44c7-bd36-9fabd48a2e1a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.586857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1069/2149] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:34.591887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92efc0-51bf-45d1-b880-59498742b454 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.599030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e379b-e1e3-488a-81fb-4212315627f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.599726 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e379b-e1e3-488a-81fb-4212315627f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.600023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e379b-e1e3-488a-81fb-4212315627f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.601598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e379b-e1e3-488a-81fb-4212315627f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.601598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e379b-e1e3-488a-81fb-4212315627f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.610870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e379b-e1e3-488a-81fb-4212315627f1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.614525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92efc0-51bf-45d1-b880-59498742b454 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.624244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2b4e1-8e93-495e-ba9f-36d2730243ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.625460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b4e1-8e93-495e-ba9f-36d2730243ec admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.625858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b4e1-8e93-495e-ba9f-36d2730243ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.626136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2b4e1-8e93-495e-ba9f-36d2730243ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.627279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2b4e1-8e93-495e-ba9f-36d2730243ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.630073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2b4e1-8e93-495e-ba9f-36d2730243ec admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.643835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1081/2150] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:34.648520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e379b-e1e3-488a-81fb-4212315627f1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.662758 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e379b-e1e3-488a-81fb-4212315627f1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.671195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf05e1-7b07-47c0-a762-3817e593d2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.672491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf05e1-7b07-47c0-a762-3817e593d2df admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.672917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf05e1-7b07-47c0-a762-3817e593d2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.673367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf05e1-7b07-47c0-a762-3817e593d2df admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.674270 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf05e1-7b07-47c0-a762-3817e593d2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.679094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1070/2151] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:34.681272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf05e1-7b07-47c0-a762-3817e593d2df admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.686871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2b4e1-8e93-495e-ba9f-36d2730243ec admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.695842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1082/2152] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:34.700531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf05e1-7b07-47c0-a762-3817e593d2df admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.714795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf05e1-7b07-47c0-a762-3817e593d2df admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.778126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2b4e1-8e93-495e-ba9f-36d2730243ec admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.783258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b92b6-ccd5-4e5d-b930-9f0d89f33a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.784026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b92b6-ccd5-4e5d-b930-9f0d89f33a44 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.784381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b92b6-ccd5-4e5d-b930-9f0d89f33a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.785122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b92b6-ccd5-4e5d-b930-9f0d89f33a44 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.785485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b92b6-ccd5-4e5d-b930-9f0d89f33a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.787698 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b92b6-ccd5-4e5d-b930-9f0d89f33a44 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.795699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49240a7e-027b-4957-aaea-fc17c75bc0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.796378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240a7e-027b-4957-aaea-fc17c75bc0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.796666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240a7e-027b-4957-aaea-fc17c75bc0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.796945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49240a7e-027b-4957-aaea-fc17c75bc0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.797771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49240a7e-027b-4957-aaea-fc17c75bc0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.799388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49240a7e-027b-4957-aaea-fc17c75bc0b7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.818293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1083/2153] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:34.820184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1071/2154] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:34.821021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49240a7e-027b-4957-aaea-fc17c75bc0b7 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.826203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b92b6-ccd5-4e5d-b930-9f0d89f33a44 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.835351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49240a7e-027b-4957-aaea-fc17c75bc0b7 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.840736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b92b6-ccd5-4e5d-b930-9f0d89f33a44 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.842655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99ccf-781c-44cb-b5d1-2070d5171dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.843638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99ccf-781c-44cb-b5d1-2070d5171dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.843978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99ccf-781c-44cb-b5d1-2070d5171dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.844255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99ccf-781c-44cb-b5d1-2070d5171dc4 admin admin] PATH_INFO: `/v3/projects/74ee77bf795c49f3ba59fe139702c9e2/users/a903015316ce4954bf11e556e8517832/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.848023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86208d48-b754-4722-8c45-d5e337eca057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.848970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208d48-b754-4722-8c45-d5e337eca057 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.849336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208d48-b754-4722-8c45-d5e337eca057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.850871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208d48-b754-4722-8c45-d5e337eca057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.851577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86208d48-b754-4722-8c45-d5e337eca057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.853304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86208d48-b754-4722-8c45-d5e337eca057 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.865472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d99ccf-781c-44cb-b5d1-2070d5171dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ee77bf795c49f3ba59fe139702c9e2, user_id=a903015316ce4954bf11e556e8517832, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.868045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1072/2155] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:34.871604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d99ccf-781c-44cb-b5d1-2070d5171dc4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.875680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86208d48-b754-4722-8c45-d5e337eca057 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:34.888064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86208d48-b754-4722-8c45-d5e337eca057 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:34.889634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1084/2156] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:34 2022] PUT /identity/v3/projects/74ee77bf795c49f3ba59fe139702c9e2/users/a903015316ce4954bf11e556e8517832/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:34.901408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69402f-14f2-458e-9bec-b908c381afbd None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.901766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69402f-14f2-458e-9bec-b908c381afbd None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.901995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69402f-14f2-458e-9bec-b908c381afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.940811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-bf69402f-14f2-458e-9bec-b908c381afbd None None] MFA Rules not processed for user `a903015316ce4954bf11e556e8517832`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:34.944146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bf69402f-14f2-458e-9bec-b908c381afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:34.974979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309888-9035-4075-b830-36fb2fd8152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:34.975652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309888-9035-4075-b830-36fb2fd8152f admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:34.975931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309888-9035-4075-b830-36fb2fd8152f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:34.976209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309888-9035-4075-b830-36fb2fd8152f admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:34.976938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86309888-9035-4075-b830-36fb2fd8152f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:34.978557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86309888-9035-4075-b830-36fb2fd8152f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:34.989867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1073/2157] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:34.993816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309888-9035-4075-b830-36fb2fd8152f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.005926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309888-9035-4075-b830-36fb2fd8152f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.013815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48fe0-69de-4b8b-8e20-2934468f0e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.015038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48fe0-69de-4b8b-8e20-2934468f0e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.015428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48fe0-69de-4b8b-8e20-2934468f0e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.015770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48fe0-69de-4b8b-8e20-2934468f0e68 admin admin] PATH_INFO: `/v3/projects/0b16e397503e4dc7a5798ad53be185dc/users/244fbcb9fadd4430b7bd61b9176c676a/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.037204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48fe0-69de-4b8b-8e20-2934468f0e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b16e397503e4dc7a5798ad53be185dc, user_id=244fbcb9fadd4430b7bd61b9176c676a, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.037429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1085/2158] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:35.037529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48fe0-69de-4b8b-8e20-2934468f0e68 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.046366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69402f-14f2-458e-9bec-b908c381afbd None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.048540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bf69402f-14f2-458e-9bec-b908c381afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:35.055021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1074/2159] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:34 2022] PUT /identity/v3/projects/0b16e397503e4dc7a5798ad53be185dc/users/244fbcb9fadd4430b7bd61b9176c676a/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:35.066100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3be16-1f35-4ca0-acf9-178d529c4864 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.066761 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3be16-1f35-4ca0-acf9-178d529c4864 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.067134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3be16-1f35-4ca0-acf9-178d529c4864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.102556 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4fe3be16-1f35-4ca0-acf9-178d529c4864 None None] MFA Rules not processed for user `244fbcb9fadd4430b7bd61b9176c676a`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:35.103812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4fe3be16-1f35-4ca0-acf9-178d529c4864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:35.123731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69402f-14f2-458e-9bec-b908c381afbd None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.175598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046fa1b-9e42-4d19-b610-40e8fa11146d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91feeca74fe749fba52423aa28d48916', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.176254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046fa1b-9e42-4d19-b610-40e8fa11146d service glance] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.176833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046fa1b-9e42-4d19-b610-40e8fa11146d service glance] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.177605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046fa1b-9e42-4d19-b610-40e8fa11146d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.179842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1075/2160] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:35.184401 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3be16-1f35-4ca0-acf9-178d529c4864 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.238343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046fa1b-9e42-4d19-b610-40e8fa11146d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.239760 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046fa1b-9e42-4d19-b610-40e8fa11146d service glance] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.249613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1086/2161] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:35.252610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3be16-1f35-4ca0-acf9-178d529c4864 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.258485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e433fc-c15a-4c46-8577-c545e4e4e446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.259153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e433fc-c15a-4c46-8577-c545e4e4e446 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.259434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e433fc-c15a-4c46-8577-c545e4e4e446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.259704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e433fc-c15a-4c46-8577-c545e4e4e446 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.260400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e433fc-c15a-4c46-8577-c545e4e4e446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.262873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e433fc-c15a-4c46-8577-c545e4e4e446 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.293347 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1076/2162] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:35 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:35.297508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046fa1b-9e42-4d19-b610-40e8fa11146d service glance] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.310030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046fa1b-9e42-4d19-b610-40e8fa11146d service glance] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.376379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f581f4-03e6-43d5-8be7-ad3117d4d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.377069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f581f4-03e6-43d5-8be7-ad3117d4d9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.377357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f581f4-03e6-43d5-8be7-ad3117d4d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.378533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f581f4-03e6-43d5-8be7-ad3117d4d9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.379240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f581f4-03e6-43d5-8be7-ad3117d4d9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.381197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f581f4-03e6-43d5-8be7-ad3117d4d9e6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.425091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1087/2163] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:35 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:35.429212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e433fc-c15a-4c46-8577-c545e4e4e446 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.444654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e433fc-c15a-4c46-8577-c545e4e4e446 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.451394 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9e858-ee1f-4c60-b8d7-7a84dc8806c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.452087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e858-ee1f-4c60-b8d7-7a84dc8806c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.452373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e858-ee1f-4c60-b8d7-7a84dc8806c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.452652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e858-ee1f-4c60-b8d7-7a84dc8806c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.453643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9e858-ee1f-4c60-b8d7-7a84dc8806c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.455395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9e858-ee1f-4c60-b8d7-7a84dc8806c1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.474576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1077/2164] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:35.478632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f581f4-03e6-43d5-8be7-ad3117d4d9e6 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.495848 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f581f4-03e6-43d5-8be7-ad3117d4d9e6 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.501057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352d2b-15aa-438c-8753-e4277c65d683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.502336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352d2b-15aa-438c-8753-e4277c65d683 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.502687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352d2b-15aa-438c-8753-e4277c65d683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.503154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25352d2b-15aa-438c-8753-e4277c65d683 admin admin] PATH_INFO: `/v3/projects/7fe6a8d71be24cc8beb2627699351ea3/users/f302d73fc22c4c44bedc46c86fcc1da9/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.521423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352d2b-15aa-438c-8753-e4277c65d683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe6a8d71be24cc8beb2627699351ea3, user_id=f302d73fc22c4c44bedc46c86fcc1da9, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.524415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25352d2b-15aa-438c-8753-e4277c65d683 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.547104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1088/2165] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:35 2022] PUT /identity/v3/projects/7fe6a8d71be24cc8beb2627699351ea3/users/f302d73fc22c4c44bedc46c86fcc1da9/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:35.551176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9e858-ee1f-4c60-b8d7-7a84dc8806c1 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.563489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9e858-ee1f-4c60-b8d7-7a84dc8806c1 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.641597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f0415-0b57-46b6-bc32-7c9c7cbca31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.642403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0415-0b57-46b6-bc32-7c9c7cbca31d admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.642985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0415-0b57-46b6-bc32-7c9c7cbca31d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.643372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f0415-0b57-46b6-bc32-7c9c7cbca31d admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.650950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f0415-0b57-46b6-bc32-7c9c7cbca31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.653117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f0415-0b57-46b6-bc32-7c9c7cbca31d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.680266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1078/2166] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:35.685527 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352d2b-15aa-438c-8753-e4277c65d683 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.697305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25352d2b-15aa-438c-8753-e4277c65d683 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.704179 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.705257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.705582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.705859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] PATH_INFO: `/v3/projects/7fe6a8d71be24cc8beb2627699351ea3/users/f302d73fc22c4c44bedc46c86fcc1da9/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.708390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe6a8d71be24cc8beb2627699351ea3, user_id=f302d73fc22c4c44bedc46c86fcc1da9, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.711178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.726284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1089/2167] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:35 2022] PUT /identity/v3/projects/7fe6a8d71be24cc8beb2627699351ea3/users/f302d73fc22c4c44bedc46c86fcc1da9/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:35.736517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09686f0e-eb68-47e2-81ba-87d413d7c118 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.736843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09686f0e-eb68-47e2-81ba-87d413d7c118 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.737115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09686f0e-eb68-47e2-81ba-87d413d7c118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.744199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.748347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:35.796023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-09686f0e-eb68-47e2-81ba-87d413d7c118 None None] MFA Rules not processed for user `f302d73fc22c4c44bedc46c86fcc1da9`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:35.797471 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-09686f0e-eb68-47e2-81ba-87d413d7c118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:35.876231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2a97-031b-4258-a770-8f0e206e8e58 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:35.891621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:35.892644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:35.892927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:35.893204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] PATH_INFO: `/v3/users/09418379357746df911dd48746e14dd5` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:35.896686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09418379357746df911dd48746e14dd5)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:35.899047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:35.973869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1079/2168] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:35.995088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09686f0e-eb68-47e2-81ba-87d413d7c118 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:35.999290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09418379357746df911dd48746e14dd5'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.001082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-09686f0e-eb68-47e2-81ba-87d413d7c118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:36.039708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09418379357746df911dd48746e14dd5'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.048408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09418379357746df911dd48746e14dd5'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.050650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09418379357746df911dd48746e14dd5'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.071702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09686f0e-eb68-47e2-81ba-87d413d7c118 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:36.073236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d4b87bb7-2a70-4c9f-9858-c184afff93c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09418379357746df911dd48746e14dd5'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.074562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:36.075335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:36.075625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:36.075961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:36.078250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:36.085376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1090/2169] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:35 2022] DELETE /identity/v3/users/09418379357746df911dd48746e14dd5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:36.088921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314ee3-ca8e-421f-aade-1b18b440a46b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:36.089752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314ee3-ca8e-421f-aade-1b18b440a46b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:36.090306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314ee3-ca8e-421f-aade-1b18b440a46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:36.116606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-7c314ee3-ca8e-421f-aade-1b18b440a46b None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:36.117853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7c314ee3-ca8e-421f-aade-1b18b440a46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:36.151476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:36.153365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:36.162941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1080/2170] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:36.184504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1091/2171] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:36.195778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:36.197228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:36.264607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb96f5-d58c-4f0d-961c-aecc12d8aa34 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:36.324012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248557c0-2fd9-497a-9e5f-3487ce7fbe56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:36.326548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248557c0-2fd9-497a-9e5f-3487ce7fbe56 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:36.327193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248557c0-2fd9-497a-9e5f-3487ce7fbe56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:36.327665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248557c0-2fd9-497a-9e5f-3487ce7fbe56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:36.339079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248557c0-2fd9-497a-9e5f-3487ce7fbe56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:36.341345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248557c0-2fd9-497a-9e5f-3487ce7fbe56 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:36.358270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1081/2172] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:36.688300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314ee3-ca8e-421f-aade-1b18b440a46b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:36.689868 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7c314ee3-ca8e-421f-aade-1b18b440a46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:36.702489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314ee3-ca8e-421f-aade-1b18b440a46b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:36.707443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:36.708299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:36.708578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:36.708844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] PATH_INFO: `/v3/projects/60f53a86e6724ca1bd063d85eaa3c6b2` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:36.710183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f53a86e6724ca1bd063d85eaa3c6b2)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:36.712090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:36.764746 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f53a86e6724ca1bd063d85eaa3c6b2', 'request_id': 'req-f04aa939-cbab-4156-9cfa-cbe67d6af4da'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.769932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f53a86e6724ca1bd063d85eaa3c6b2', 'request_id': 'req-f04aa939-cbab-4156-9cfa-cbe67d6af4da'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.777973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f53a86e6724ca1bd063d85eaa3c6b2', 'request_id': 'req-f04aa939-cbab-4156-9cfa-cbe67d6af4da'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.788979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] The token cache is being invalidate because project 60f53a86e6724ca1bd063d85eaa3c6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:36.789263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.789945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f04aa939-cbab-4156-9cfa-cbe67d6af4da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:36.791487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1092/2173] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:36 2022] DELETE /identity/v3/projects/60f53a86e6724ca1bd063d85eaa3c6b2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:36.797143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957e5f-0dc2-4c48-8a4c-f4af18293167 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:36.797692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957e5f-0dc2-4c48-8a4c-f4af18293167 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:36.797842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5957e5f-0dc2-4c48-8a4c-f4af18293167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:36.815439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f5957e5f-0dc2-4c48-8a4c-f4af18293167 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:36.816885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f5957e5f-0dc2-4c48-8a4c-f4af18293167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:36.875077 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1082/2174] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:36.882995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25a1b-23cb-4b3c-99a6-c6a98172c524 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:36.883308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25a1b-23cb-4b3c-99a6-c6a98172c524 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:36.883582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25a1b-23cb-4b3c-99a6-c6a98172c524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:36.901317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-63f25a1b-23cb-4b3c-99a6-c6a98172c524 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:36.902548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-63f25a1b-23cb-4b3c-99a6-c6a98172c524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:36.910254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1093/2175] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:36.914137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957e5f-0dc2-4c48-8a4c-f4af18293167 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:36.923979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5957e5f-0dc2-4c48-8a4c-f4af18293167 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:36.928511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:36.929159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:36.929447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:36.929773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:36.930499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:36.930811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:36.932413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:36.945735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1083/2176] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:36.949857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f25a1b-23cb-4b3c-99a6-c6a98172c524 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:36.958801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f25a1b-23cb-4b3c-99a6-c6a98172c524 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:36.963425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1ad84-9bc4-427d-80af-22d1154bb9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:36.964089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1ad84-9bc4-427d-80af-22d1154bb9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:36.964370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1ad84-9bc4-427d-80af-22d1154bb9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:36.964642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1ad84-9bc4-427d-80af-22d1154bb9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:36.965341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1ad84-9bc4-427d-80af-22d1154bb9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:36.967286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1ad84-9bc4-427d-80af-22d1154bb9d9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:36.992693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1094/2177] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:36 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:36.997672 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:37.007825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab4d5e-1985-4556-89de-9b74f00ff7fb admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:37.063126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957aa7-7305-495c-887a-fcc242ea9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:37.063793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957aa7-7305-495c-887a-fcc242ea9d5a admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:37.064081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957aa7-7305-495c-887a-fcc242ea9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:37.064361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a957aa7-7305-495c-887a-fcc242ea9d5a admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:37.065047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a957aa7-7305-495c-887a-fcc242ea9d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:37.067252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a957aa7-7305-495c-887a-fcc242ea9d5a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:37.085961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1084/2178] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:36 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:37.090650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1ad84-9bc4-427d-80af-22d1154bb9d9 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:37.100739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1ad84-9bc4-427d-80af-22d1154bb9d9 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:37.105991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8aa05-1de6-484f-9558-40efd9a83162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:37.106645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8aa05-1de6-484f-9558-40efd9a83162 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:37.106926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8aa05-1de6-484f-9558-40efd9a83162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:37.107321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8aa05-1de6-484f-9558-40efd9a83162 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:37.107944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8aa05-1de6-484f-9558-40efd9a83162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:37.109534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8aa05-1de6-484f-9558-40efd9a83162 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:37.124125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1095/2179] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:37.128359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957aa7-7305-495c-887a-fcc242ea9d5a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:37.138376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a957aa7-7305-495c-887a-fcc242ea9d5a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:37.142991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691af3b3-ad90-4143-b171-9a8d06813515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:37.143643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691af3b3-ad90-4143-b171-9a8d06813515 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:37.143930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691af3b3-ad90-4143-b171-9a8d06813515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:37.144209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691af3b3-ad90-4143-b171-9a8d06813515 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:37.144933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691af3b3-ad90-4143-b171-9a8d06813515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:37.146563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691af3b3-ad90-4143-b171-9a8d06813515 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:37.156662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1085/2180] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:37.160542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8aa05-1de6-484f-9558-40efd9a83162 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:37.170932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8aa05-1de6-484f-9558-40efd9a83162 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:37.175466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:37.176326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:37.176606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:37.176909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] PATH_INFO: `/v3/projects/74239c7bf10042db8dfd06985396562c/users/e39b48a7673547b295932d8938b702c3/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:37.199121 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74239c7bf10042db8dfd06985396562c, user_id=e39b48a7673547b295932d8938b702c3, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:37.201796 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:37.214102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1096/2181] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:37 2022] PUT /identity/v3/projects/74239c7bf10042db8dfd06985396562c/users/e39b48a7673547b295932d8938b702c3/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:37.225625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594cdb1-f2fb-480e-b286-d992c3fab764 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:37.225943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594cdb1-f2fb-480e-b286-d992c3fab764 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:37.226217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594cdb1-f2fb-480e-b286-d992c3fab764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:37.254511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1594cdb1-f2fb-480e-b286-d992c3fab764 None None] MFA Rules not processed for user `e39b48a7673547b295932d8938b702c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:37.255712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1594cdb1-f2fb-480e-b286-d992c3fab764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:37.315515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1086/2182] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:37.326676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:37.328619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:37.384277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec13ef3-ed6d-47ab-a05b-258b391ebd7c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:37.387890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82bea-51ae-4b49-88fb-0fd4e833f8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:37.388528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82bea-51ae-4b49-88fb-0fd4e833f8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:37.388809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82bea-51ae-4b49-88fb-0fd4e833f8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:37.389084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d82bea-51ae-4b49-88fb-0fd4e833f8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:37.397100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82bea-51ae-4b49-88fb-0fd4e833f8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:37.398563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d82bea-51ae-4b49-88fb-0fd4e833f8e1 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:37.407846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1097/2183] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:39.876134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594cdb1-f2fb-480e-b286-d992c3fab764 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:39.877876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1594cdb1-f2fb-480e-b286-d992c3fab764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:39.893320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594cdb1-f2fb-480e-b286-d992c3fab764 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:39.897382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:39.898071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:39.898360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:39.898642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:39.900446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:39.974012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:39.975901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:39.985444 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1087/2184] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:41.351328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82bea-51ae-4b49-88fb-0fd4e833f8e1 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:41.360443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d82bea-51ae-4b49-88fb-0fd4e833f8e1 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:41.364169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9470d5-e396-49aa-93cf-f48a52aa0607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:41.364871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9470d5-e396-49aa-93cf-f48a52aa0607 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:41.365158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9470d5-e396-49aa-93cf-f48a52aa0607 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:41.365431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9470d5-e396-49aa-93cf-f48a52aa0607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:41.367242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0d9470d5-e396-49aa-93cf-f48a52aa0607 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:41.429754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9470d5-e396-49aa-93cf-f48a52aa0607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:41.431214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9470d5-e396-49aa-93cf-f48a52aa0607 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:41.441786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1098/2185] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:45.465994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:45.467420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:45.530645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa63a58-141d-4d17-86ff-9edb7e4359e6 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:45.535119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:45.535988 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:45.536275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:45.536555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] PATH_INFO: `/v3/users/5da3e6c7a0e144468b296a4f1ba74bfe` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:45.537770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da3e6c7a0e144468b296a4f1ba74bfe)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:45.539706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:45.585100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da3e6c7a0e144468b296a4f1ba74bfe'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:45.596610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da3e6c7a0e144468b296a4f1ba74bfe'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:45.597251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da3e6c7a0e144468b296a4f1ba74bfe'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:45.603860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da3e6c7a0e144468b296a4f1ba74bfe'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:45.604474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da3e6c7a0e144468b296a4f1ba74bfe'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:45.616623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1088/2186] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:45 2022] DELETE /identity/v3/users/5da3e6c7a0e144468b296a4f1ba74bfe => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:45.621404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766abd-6d8d-48b9-8322-1f8f3aff2118 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:45.621909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766abd-6d8d-48b9-8322-1f8f3aff2118 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:45.622023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3766abd-6d8d-48b9-8322-1f8f3aff2118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:45.639143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e3766abd-6d8d-48b9-8322-1f8f3aff2118 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:45.640322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e3766abd-6d8d-48b9-8322-1f8f3aff2118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:45.696854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1099/2187] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:45.706859 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:45.708225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:45.766158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f27763-2d51-4c04-93fa-be1da8b8e9f4 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:45.769776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64fa3e-5b92-4450-9b00-e62430541ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:45.770417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fa3e-5b92-4450-9b00-e62430541ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:45.770705 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fa3e-5b92-4450-9b00-e62430541ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:45.770974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64fa3e-5b92-4450-9b00-e62430541ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:45.780352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64fa3e-5b92-4450-9b00-e62430541ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:45.781909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64fa3e-5b92-4450-9b00-e62430541ac6 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:45.791375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1089/2188] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:46.131864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766abd-6d8d-48b9-8322-1f8f3aff2118 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:46.133403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e3766abd-6d8d-48b9-8322-1f8f3aff2118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:46.148178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3766abd-6d8d-48b9-8322-1f8f3aff2118 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:46.153344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:46.154316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:46.154688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:46.155091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] PATH_INFO: `/v3/projects/df7ad26e1846482f94a8017d8deb10de` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:46.156292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7ad26e1846482f94a8017d8deb10de)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:46.158371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:46.207323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7ad26e1846482f94a8017d8deb10de', 'request_id': 'req-d0f88f04-c9c1-4a26-a412-3ad41576aa69'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.212436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7ad26e1846482f94a8017d8deb10de', 'request_id': 'req-d0f88f04-c9c1-4a26-a412-3ad41576aa69'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.219637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7ad26e1846482f94a8017d8deb10de', 'request_id': 'req-d0f88f04-c9c1-4a26-a412-3ad41576aa69'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.231158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] The token cache is being invalidate because project df7ad26e1846482f94a8017d8deb10de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:46.231451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.232103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.233745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1100/2189] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:46 2022] DELETE /identity/v3/projects/df7ad26e1846482f94a8017d8deb10de => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:46.237886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64fa3e-5b92-4450-9b00-e62430541ac6 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:46.248053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64fa3e-5b92-4450-9b00-e62430541ac6 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:46.302543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:46.303328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:46.303611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:46.303884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] PATH_INFO: `/v3/users/bd66fbf272134bf9b9f328e16f2cb458` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:46.305058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd66fbf272134bf9b9f328e16f2cb458)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:46.307017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:46.351829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd66fbf272134bf9b9f328e16f2cb458'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.364697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd66fbf272134bf9b9f328e16f2cb458'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.365576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd66fbf272134bf9b9f328e16f2cb458'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.372888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd66fbf272134bf9b9f328e16f2cb458'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.373628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4739ebe4-3ac2-4711-add0-9308202c9509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd66fbf272134bf9b9f328e16f2cb458'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.386668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1090/2190] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:46 2022] DELETE /identity/v3/users/bd66fbf272134bf9b9f328e16f2cb458 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:46.672913 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:46.674622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:46.688468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f88f04-c9c1-4a26-a412-3ad41576aa69 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:46.746834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:46.747705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:46.747987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:46.748260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] PATH_INFO: `/v3/projects/34a355b3223247a48c4be3200ce381c0` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:46.749454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a355b3223247a48c4be3200ce381c0)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:46.751383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:46.797532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a355b3223247a48c4be3200ce381c0', 'request_id': 'req-3f25d13e-21d7-4fd2-90f4-c38dae00232a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.802834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a355b3223247a48c4be3200ce381c0', 'request_id': 'req-3f25d13e-21d7-4fd2-90f4-c38dae00232a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.813341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a355b3223247a48c4be3200ce381c0', 'request_id': 'req-3f25d13e-21d7-4fd2-90f4-c38dae00232a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.822300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] The token cache is being invalidate because project 34a355b3223247a48c4be3200ce381c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:46.822720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.824160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-3f25d13e-21d7-4fd2-90f4-c38dae00232a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:46.825812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1101/2191] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:46 2022] DELETE /identity/v3/projects/34a355b3223247a48c4be3200ce381c0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:46.830644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17d8cf-f911-4c7a-b502-abf174774831 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:46.831111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17d8cf-f911-4c7a-b502-abf174774831 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:46.831198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17d8cf-f911-4c7a-b502-abf174774831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:46.850609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ef17d8cf-f911-4c7a-b502-abf174774831 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:46.851842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ef17d8cf-f911-4c7a-b502-abf174774831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:46.913978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1091/2192] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:46.922735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f03f4e-088c-4faa-a810-5c8430c88ca3 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:46.923024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f03f4e-088c-4faa-a810-5c8430c88ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:46.923300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f03f4e-088c-4faa-a810-5c8430c88ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:46.941915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a9f03f4e-088c-4faa-a810-5c8430c88ca3 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:46.943110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a9f03f4e-088c-4faa-a810-5c8430c88ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:46.951879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1102/2193] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:46.956157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17d8cf-f911-4c7a-b502-abf174774831 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:46.966346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17d8cf-f911-4c7a-b502-abf174774831 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:46.971466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:46.972137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:46.972418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:46.972690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:46.973409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:46.973740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:46.975365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:46.987781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1092/2194] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:46.992243 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f03f4e-088c-4faa-a810-5c8430c88ca3 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.001403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f03f4e-088c-4faa-a810-5c8430c88ca3 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.006192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388a390-f53f-4580-88e0-3e550e9c0698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.006680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388a390-f53f-4580-88e0-3e550e9c0698 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.006967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388a390-f53f-4580-88e0-3e550e9c0698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.007247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388a390-f53f-4580-88e0-3e550e9c0698 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.007937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388a390-f53f-4580-88e0-3e550e9c0698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.010038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388a390-f53f-4580-88e0-3e550e9c0698 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.035212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1103/2195] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:46 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:47.039514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.050159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90d150-856d-4417-87d9-4d7862397956 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.106629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d59b4-261c-4d9c-9640-f932f869326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.107376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d59b4-261c-4d9c-9640-f932f869326f admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.107721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d59b4-261c-4d9c-9640-f932f869326f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.108057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d59b4-261c-4d9c-9640-f932f869326f admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.108820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d59b4-261c-4d9c-9640-f932f869326f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.110901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d59b4-261c-4d9c-9640-f932f869326f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.131111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1093/2196] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:47 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:47.135340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388a390-f53f-4580-88e0-3e550e9c0698 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.146182 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388a390-f53f-4580-88e0-3e550e9c0698 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.150741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a25f35-4d02-4d5b-b87e-9acc9835878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.151408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a25f35-4d02-4d5b-b87e-9acc9835878a admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.151715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a25f35-4d02-4d5b-b87e-9acc9835878a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.151987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a25f35-4d02-4d5b-b87e-9acc9835878a admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.153207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a25f35-4d02-4d5b-b87e-9acc9835878a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.154843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a25f35-4d02-4d5b-b87e-9acc9835878a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.165692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1104/2197] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:47.170183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d59b4-261c-4d9c-9640-f932f869326f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.180966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d59b4-261c-4d9c-9640-f932f869326f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.185928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcc08c-cb5d-4869-b5fd-0f7e8fd75283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.186991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcc08c-cb5d-4869-b5fd-0f7e8fd75283 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.186991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcc08c-cb5d-4869-b5fd-0f7e8fd75283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.187135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcc08c-cb5d-4869-b5fd-0f7e8fd75283 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.187879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcc08c-cb5d-4869-b5fd-0f7e8fd75283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.189504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcc08c-cb5d-4869-b5fd-0f7e8fd75283 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.200889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1094/2198] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:47.205202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a25f35-4d02-4d5b-b87e-9acc9835878a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.216971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a25f35-4d02-4d5b-b87e-9acc9835878a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.221991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f51d6-f47f-4743-90bc-63fbd98ff237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.222887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f51d6-f47f-4743-90bc-63fbd98ff237 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.223172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f51d6-f47f-4743-90bc-63fbd98ff237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.223449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f51d6-f47f-4743-90bc-63fbd98ff237 admin admin] PATH_INFO: `/v3/projects/f5e261af71e348b7b71ea62f9da7d1a4/users/b9c41b36f9ea4fb5a03b72ea8c7f12e3/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.238282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f51d6-f47f-4743-90bc-63fbd98ff237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e261af71e348b7b71ea62f9da7d1a4, user_id=b9c41b36f9ea4fb5a03b72ea8c7f12e3, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.241100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f51d6-f47f-4743-90bc-63fbd98ff237 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.255840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1105/2199] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:47 2022] PUT /identity/v3/projects/f5e261af71e348b7b71ea62f9da7d1a4/users/b9c41b36f9ea4fb5a03b72ea8c7f12e3/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:47.267557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a2818-b03c-403c-b98e-9d6d5d19c9d1 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.267849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a2818-b03c-403c-b98e-9d6d5d19c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.268132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a2818-b03c-403c-b98e-9d6d5d19c9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.293907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-9d5a2818-b03c-403c-b98e-9d6d5d19c9d1 None None] MFA Rules not processed for user `b9c41b36f9ea4fb5a03b72ea8c7f12e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:47.295098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9d5a2818-b03c-403c-b98e-9d6d5d19c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:47.357712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1095/2200] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:47.362088 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f51d6-f47f-4743-90bc-63fbd98ff237 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.424844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f51d6-f47f-4743-90bc-63fbd98ff237 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.429446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b62f18-9b4b-4f33-ba75-391c7bacf151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.430130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62f18-9b4b-4f33-ba75-391c7bacf151 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.430413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62f18-9b4b-4f33-ba75-391c7bacf151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.430685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b62f18-9b4b-4f33-ba75-391c7bacf151 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.431390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b62f18-9b4b-4f33-ba75-391c7bacf151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.433287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b62f18-9b4b-4f33-ba75-391c7bacf151 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.466982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1106/2201] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:47 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:47.468111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a2818-b03c-403c-b98e-9d6d5d19c9d1 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.478626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a2818-b03c-403c-b98e-9d6d5d19c9d1 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.536339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48d32-aab3-4466-9186-30bcc57b11e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.537026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48d32-aab3-4466-9186-30bcc57b11e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.537305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48d32-aab3-4466-9186-30bcc57b11e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.537624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb48d32-aab3-4466-9186-30bcc57b11e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.538331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48d32-aab3-4466-9186-30bcc57b11e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.540261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb48d32-aab3-4466-9186-30bcc57b11e9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.562528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1096/2202] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:47 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:47.568075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b62f18-9b4b-4f33-ba75-391c7bacf151 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.579822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b62f18-9b4b-4f33-ba75-391c7bacf151 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.584457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c468bd-511a-4ad1-9019-4d09cabbed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.585123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c468bd-511a-4ad1-9019-4d09cabbed42 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.585407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c468bd-511a-4ad1-9019-4d09cabbed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.585724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c468bd-511a-4ad1-9019-4d09cabbed42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.586479 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c468bd-511a-4ad1-9019-4d09cabbed42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.588095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c468bd-511a-4ad1-9019-4d09cabbed42 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.598482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1107/2203] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:47.602626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48d32-aab3-4466-9186-30bcc57b11e9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.612614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb48d32-aab3-4466-9186-30bcc57b11e9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.617768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805db839-7848-43cd-8de7-711f50f76aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.618730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805db839-7848-43cd-8de7-711f50f76aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.618993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805db839-7848-43cd-8de7-711f50f76aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.619264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805db839-7848-43cd-8de7-711f50f76aa5 admin admin] PATH_INFO: `/v3/projects/ea6bfc9a600641d394f56f0046b61d52/users/36b2d58dd0d741d18c7a694e57538be7/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.635145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805db839-7848-43cd-8de7-711f50f76aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bfc9a600641d394f56f0046b61d52, user_id=36b2d58dd0d741d18c7a694e57538be7, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.638488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805db839-7848-43cd-8de7-711f50f76aa5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.652938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1097/2204] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:47 2022] PUT /identity/v3/projects/ea6bfc9a600641d394f56f0046b61d52/users/36b2d58dd0d741d18c7a694e57538be7/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:47.657399 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c468bd-511a-4ad1-9019-4d09cabbed42 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.667472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c468bd-511a-4ad1-9019-4d09cabbed42 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.726423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab126b5-9ca6-4ca7-9144-f3401939c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.729967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab126b5-9ca6-4ca7-9144-f3401939c2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.730264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab126b5-9ca6-4ca7-9144-f3401939c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.730550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab126b5-9ca6-4ca7-9144-f3401939c2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.731347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab126b5-9ca6-4ca7-9144-f3401939c2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.733018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab126b5-9ca6-4ca7-9144-f3401939c2f2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.743565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1108/2205] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:47.748354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805db839-7848-43cd-8de7-711f50f76aa5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.758967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805db839-7848-43cd-8de7-711f50f76aa5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.764650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.765640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.765933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.766210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] PATH_INFO: `/v3/projects/ea6bfc9a600641d394f56f0046b61d52/users/36b2d58dd0d741d18c7a694e57538be7/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.768214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6bfc9a600641d394f56f0046b61d52, user_id=36b2d58dd0d741d18c7a694e57538be7, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.771528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.782072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1098/2206] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:47 2022] PUT /identity/v3/projects/ea6bfc9a600641d394f56f0046b61d52/users/36b2d58dd0d741d18c7a694e57538be7/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:47.791936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6622b-5cb9-4234-b6df-563a4dabbcdf None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.792351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6622b-5cb9-4234-b6df-563a4dabbcdf None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.792739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6622b-5cb9-4234-b6df-563a4dabbcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.818978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-04e6622b-5cb9-4234-b6df-563a4dabbcdf None None] MFA Rules not processed for user `36b2d58dd0d741d18c7a694e57538be7`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:47.820186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-04e6622b-5cb9-4234-b6df-563a4dabbcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:47.889296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1109/2207] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:47.902411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:47.904522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:47.963489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1e6e9-dca6-4cae-bfb7-d22d07101056 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:47.967317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:47.967966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:47.968252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:47.968527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:47.978443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:47.979883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:47.990172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1099/2208] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:48.401826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6622b-5cb9-4234-b6df-563a4dabbcdf None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:48.483385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6622b-5cb9-4234-b6df-563a4dabbcdf None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:48.488918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:48.492545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:48.492545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:48.492545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] PATH_INFO: `/v3/users/b9c41b36f9ea4fb5a03b72ea8c7f12e3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:48.493219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c41b36f9ea4fb5a03b72ea8c7f12e3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:48.495229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:48.575461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c41b36f9ea4fb5a03b72ea8c7f12e3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.591037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c41b36f9ea4fb5a03b72ea8c7f12e3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.601491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c41b36f9ea4fb5a03b72ea8c7f12e3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.604993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c41b36f9ea4fb5a03b72ea8c7f12e3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.623569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6ce317e4-55af-4e0a-9572-dbd72b395bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c41b36f9ea4fb5a03b72ea8c7f12e3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.625895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:48.627536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:48.632790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1110/2209] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:48 2022] DELETE /identity/v3/users/b9c41b36f9ea4fb5a03b72ea8c7f12e3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:48.642066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1089f2-04d0-4a2d-97c3-daf3f61cdd62 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:48.642066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1089f2-04d0-4a2d-97c3-daf3f61cdd62 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:48.643337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1089f2-04d0-4a2d-97c3-daf3f61cdd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:48.655427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ec4dd-e31a-4739-8858-ea20168f4260 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:48.672707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ea1089f2-04d0-4a2d-97c3-daf3f61cdd62 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:48.674011 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ea1089f2-04d0-4a2d-97c3-daf3f61cdd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:48.752653 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:48.753519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:48.753838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:48.754107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] PATH_INFO: `/v3/users/52a4de2a2ff2440589b53a097a2a6bd2` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:48.755338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a4de2a2ff2440589b53a097a2a6bd2)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:48.757282 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:48.766290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1111/2210] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:48.776986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1089f2-04d0-4a2d-97c3-daf3f61cdd62 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:48.778812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ea1089f2-04d0-4a2d-97c3-daf3f61cdd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:48.822489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a4de2a2ff2440589b53a097a2a6bd2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.841431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a4de2a2ff2440589b53a097a2a6bd2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.842328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a4de2a2ff2440589b53a097a2a6bd2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.850598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a4de2a2ff2440589b53a097a2a6bd2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.851568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-140e3134-b039-448e-aaea-b194d66cf8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a4de2a2ff2440589b53a097a2a6bd2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:48.866747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1100/2211] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:48 2022] DELETE /identity/v3/users/52a4de2a2ff2440589b53a097a2a6bd2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:48.870287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1089f2-04d0-4a2d-97c3-daf3f61cdd62 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:48.872946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867420-1854-4f68-8e70-a3ff0a32e645 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:48.873235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867420-1854-4f68-8e70-a3ff0a32e645 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:48.873522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867420-1854-4f68-8e70-a3ff0a32e645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:48.894786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-38867420-1854-4f68-8e70-a3ff0a32e645 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:48.897180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-38867420-1854-4f68-8e70-a3ff0a32e645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:48.934901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:48.937222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:48.937750 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:48.938159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:48.940439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:48.973673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1101/2212] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:48.985934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867420-1854-4f68-8e70-a3ff0a32e645 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:48.987480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-38867420-1854-4f68-8e70-a3ff0a32e645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:49.002832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867420-1854-4f68-8e70-a3ff0a32e645 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:49.009728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:49.010509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:49.010897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:49.011279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:49.018353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:49.022794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:49.022958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:49.024162 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:49.034844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1112/2213] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:39:49.037718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1102/2214] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:49.345484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:49.346991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:49.364773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc32da-b4f3-4f81-b4a0-ce4081a68486 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:49.365645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:49.367965 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:49.370054 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:49.382099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:49.382099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:49.382369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] PATH_INFO: `/v3/projects/d8489c3acbb541d68846ca2ab65b7fc0` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:49.384246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8489c3acbb541d68846ca2ab65b7fc0)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:49.386306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:49.386568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf3264-7fcb-47d6-a7ce-4e481e5417a6 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:49.392514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:49.393530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:49.394011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:49.394446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] PATH_INFO: `/v3/projects/f5e261af71e348b7b71ea62f9da7d1a4` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:49.396112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e261af71e348b7b71ea62f9da7d1a4)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:49.399342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:49.436082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8489c3acbb541d68846ca2ab65b7fc0', 'request_id': 'req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.442699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8489c3acbb541d68846ca2ab65b7fc0', 'request_id': 'req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.449015 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e261af71e348b7b71ea62f9da7d1a4', 'request_id': 'req-66b2f143-76a3-48b2-b3bb-fd5752929c30'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.451797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8489c3acbb541d68846ca2ab65b7fc0', 'request_id': 'req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.455686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e261af71e348b7b71ea62f9da7d1a4', 'request_id': 'req-66b2f143-76a3-48b2-b3bb-fd5752929c30'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.462640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e261af71e348b7b71ea62f9da7d1a4', 'request_id': 'req-66b2f143-76a3-48b2-b3bb-fd5752929c30'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.465012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] The token cache is being invalidate because project d8489c3acbb541d68846ca2ab65b7fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:49.465012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.466028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.467646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1113/2215] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:49 2022] DELETE /identity/v3/projects/d8489c3acbb541d68846ca2ab65b7fc0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:49.471903 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:49.473321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:49.474498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] The token cache is being invalidate because project f5e261af71e348b7b71ea62f9da7d1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:49.474795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.475451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.477000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1103/2216] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:49 2022] DELETE /identity/v3/projects/f5e261af71e348b7b71ea62f9da7d1a4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:49.480816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:49.482186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:49.540045 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c45bb3-e338-4d0d-adfa-4fc8b3f01131 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:49.545495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:49.545930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2f143-76a3-48b2-b3bb-fd5752929c30 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:49.546407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:49.546696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:49.546973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] PATH_INFO: `/v3/users/244fbcb9fadd4430b7bd61b9176c676a` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:49.548188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244fbcb9fadd4430b7bd61b9176c676a)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:49.550159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:49.551049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:49.551920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:49.552684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:49.552684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] PATH_INFO: `/v3/users/36b2d58dd0d741d18c7a694e57538be7` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:49.553963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b2d58dd0d741d18c7a694e57538be7)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:49.555948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:49.604132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244fbcb9fadd4430b7bd61b9176c676a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.606652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b2d58dd0d741d18c7a694e57538be7'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.616027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244fbcb9fadd4430b7bd61b9176c676a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.618380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b2d58dd0d741d18c7a694e57538be7'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.620081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b2d58dd0d741d18c7a694e57538be7'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.623696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244fbcb9fadd4430b7bd61b9176c676a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.624215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244fbcb9fadd4430b7bd61b9176c676a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.630134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b2d58dd0d741d18c7a694e57538be7'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.631920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b2d58dd0d741d18c7a694e57538be7'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.634148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244fbcb9fadd4430b7bd61b9176c676a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:49.641851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1114/2217] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:49 2022] DELETE /identity/v3/users/244fbcb9fadd4430b7bd61b9176c676a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:49.647922 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1104/2218] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:49 2022] DELETE /identity/v3/users/36b2d58dd0d741d18c7a694e57538be7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:50.096335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.098587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:50.183046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f36c-903a-47ad-8b63-5b0389c0eac4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.196399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.200019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:50.287135 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.288517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.289007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.289482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] PATH_INFO: `/v3/projects/ea6bfc9a600641d394f56f0046b61d52` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.291541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6bfc9a600641d394f56f0046b61d52)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.294405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.296555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3d1d-bff3-4af4-ad14-33b9183965f3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.303894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.304944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.305381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.305834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] PATH_INFO: `/v3/projects/0b16e397503e4dc7a5798ad53be185dc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.307055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b16e397503e4dc7a5798ad53be185dc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.309175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.361690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6bfc9a600641d394f56f0046b61d52', 'request_id': 'req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.365110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b16e397503e4dc7a5798ad53be185dc', 'request_id': 'req-d8ae5c48-087a-43ac-8251-e6604bcf35fb'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.367571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6bfc9a600641d394f56f0046b61d52', 'request_id': 'req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.371768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b16e397503e4dc7a5798ad53be185dc', 'request_id': 'req-d8ae5c48-087a-43ac-8251-e6604bcf35fb'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.376003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6bfc9a600641d394f56f0046b61d52', 'request_id': 'req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.383106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b16e397503e4dc7a5798ad53be185dc', 'request_id': 'req-d8ae5c48-087a-43ac-8251-e6604bcf35fb'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.390672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] The token cache is being invalidate because project ea6bfc9a600641d394f56f0046b61d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:50.390968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.391635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a04fe2f8-5f0b-4d68-a7a4-be8d0cf0e79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.393180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1115/2219] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:50 2022] DELETE /identity/v3/projects/ea6bfc9a600641d394f56f0046b61d52 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:50.398094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f142-6b13-4771-a49c-0cbdea2ebf72 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.398389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f142-6b13-4771-a49c-0cbdea2ebf72 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.399248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f142-6b13-4771-a49c-0cbdea2ebf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.403495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] The token cache is being invalidate because project 0b16e397503e4dc7a5798ad53be185dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:50.404022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.405568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.407300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1105/2220] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:50 2022] DELETE /identity/v3/projects/0b16e397503e4dc7a5798ad53be185dc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:50.411188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.412845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:50.422699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-28c8f142-6b13-4771-a49c-0cbdea2ebf72 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:50.423984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-28c8f142-6b13-4771-a49c-0cbdea2ebf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:50.492022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae5c48-087a-43ac-8251-e6604bcf35fb admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.492445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1116/2221] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:50.501171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a615dd-06c5-4acb-b218-bae00969066c None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.501465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a615dd-06c5-4acb-b218-bae00969066c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.501782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a615dd-06c5-4acb-b218-bae00969066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.504537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.505743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.506115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.507091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] PATH_INFO: `/v3/users/f302d73fc22c4c44bedc46c86fcc1da9` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.508592 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f302d73fc22c4c44bedc46c86fcc1da9)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.510959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.522622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f9a615dd-06c5-4acb-b218-bae00969066c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:50.523926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f9a615dd-06c5-4acb-b218-bae00969066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:50.533589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1117/2222] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:50.538845 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a615dd-06c5-4acb-b218-bae00969066c None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.548331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a615dd-06c5-4acb-b218-bae00969066c None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.563955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.564717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.565383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.565517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.566715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:50.566873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.571072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.587478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1118/2223] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:39:50.589983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f302d73fc22c4c44bedc46c86fcc1da9'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.592706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.603546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb0e6b-7fe4-4aad-88bb-bfb3cda3ec31 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.606927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f302d73fc22c4c44bedc46c86fcc1da9'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.613975 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f302d73fc22c4c44bedc46c86fcc1da9'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.617508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8ac25-a69c-40ca-9fe1-ad821ec17ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.618310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8ac25-a69c-40ca-9fe1-ad821ec17ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.618670 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8ac25-a69c-40ca-9fe1-ad821ec17ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.619018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8ac25-a69c-40ca-9fe1-ad821ec17ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.619788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8ac25-a69c-40ca-9fe1-ad821ec17ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.621969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f302d73fc22c4c44bedc46c86fcc1da9'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.622494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8ac25-a69c-40ca-9fe1-ad821ec17ec1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.622613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f302d73fc22c4c44bedc46c86fcc1da9'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:50.640823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1106/2224] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:39:50 2022] DELETE /identity/v3/users/f302d73fc22c4c44bedc46c86fcc1da9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:50.656695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1119/2225] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:50 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:50.660908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.662469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:50.739849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8be21b-db21-4ffc-a280-789c1a48e70b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.820217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810e834-d826-402b-9703-47c8378e5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.820844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810e834-d826-402b-9703-47c8378e5116 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.821236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810e834-d826-402b-9703-47c8378e5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.821420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810e834-d826-402b-9703-47c8378e5116 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.822250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810e834-d826-402b-9703-47c8378e5116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.824188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810e834-d826-402b-9703-47c8378e5116 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.848566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1107/2226] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:50 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:50.851979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8ac25-a69c-40ca-9fe1-ad821ec17ec1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.865128 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8ac25-a69c-40ca-9fe1-ad821ec17ec1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.870073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3587-25b8-4ca7-8b00-8db7b4e55614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.870919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3587-25b8-4ca7-8b00-8db7b4e55614 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.871745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3587-25b8-4ca7-8b00-8db7b4e55614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.872118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3587-25b8-4ca7-8b00-8db7b4e55614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.872849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef3587-25b8-4ca7-8b00-8db7b4e55614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.874713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef3587-25b8-4ca7-8b00-8db7b4e55614 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.890225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1120/2227] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:50.891495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810e834-d826-402b-9703-47c8378e5116 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.902003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810e834-d826-402b-9703-47c8378e5116 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.907027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.907709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.908058 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.908339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.909083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.910745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.920810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1108/2228] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:50.927543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3587-25b8-4ca7-8b00-8db7b4e55614 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.937477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3587-25b8-4ca7-8b00-8db7b4e55614 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.944114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5d3e3-bbaa-450a-89b3-db1670e89614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:50.945259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d3e3-bbaa-450a-89b3-db1670e89614 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.945773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d3e3-bbaa-450a-89b3-db1670e89614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.945985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d3e3-bbaa-450a-89b3-db1670e89614 admin admin] PATH_INFO: `/v3/projects/a820f412a2924c43831407fffcd86d8b/users/b46ca46b12284e919c15a1782dec32f6/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:50.957654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:50.960280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:50.965397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5d3e3-bbaa-450a-89b3-db1670e89614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a820f412a2924c43831407fffcd86d8b, user_id=b46ca46b12284e919c15a1782dec32f6, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:50.969665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5d3e3-bbaa-450a-89b3-db1670e89614 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:50.976125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd9270-1cf1-4f65-9fe0-67da75ef721c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:50.985235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1121/2229] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:50 2022] PUT /identity/v3/projects/a820f412a2924c43831407fffcd86d8b/users/b46ca46b12284e919c15a1782dec32f6/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:50.997153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112b83-9816-45a9-add1-d91b45e172ce None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:50.997353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112b83-9816-45a9-add1-d91b45e172ce None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:50.997637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc112b83-9816-45a9-add1-d91b45e172ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.024625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-cc112b83-9816-45a9-add1-d91b45e172ce None None] MFA Rules not processed for user `b46ca46b12284e919c15a1782dec32f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:51.025870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cc112b83-9816-45a9-add1-d91b45e172ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:51.043176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.044044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.044333 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.044607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] PATH_INFO: `/v3/projects/7fe6a8d71be24cc8beb2627699351ea3` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.045847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe6a8d71be24cc8beb2627699351ea3)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.047788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.094746 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1122/2230] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:51.096112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe6a8d71be24cc8beb2627699351ea3', 'request_id': 'req-e75b9ac3-19df-41b5-8077-80e06ef8db50'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:51.099066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112b83-9816-45a9-add1-d91b45e172ce None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.102140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe6a8d71be24cc8beb2627699351ea3', 'request_id': 'req-e75b9ac3-19df-41b5-8077-80e06ef8db50'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:51.110628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc112b83-9816-45a9-add1-d91b45e172ce None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.112064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe6a8d71be24cc8beb2627699351ea3', 'request_id': 'req-e75b9ac3-19df-41b5-8077-80e06ef8db50'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:51.123787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] The token cache is being invalidate because project 7fe6a8d71be24cc8beb2627699351ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:39:51.124679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:51.125341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e75b9ac3-19df-41b5-8077-80e06ef8db50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:39:51.126937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1109/2231] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:39:50 2022] DELETE /identity/v3/projects/7fe6a8d71be24cc8beb2627699351ea3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:51.131960 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69fcff-5a72-4481-90e0-947d802b4b09 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.132246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69fcff-5a72-4481-90e0-947d802b4b09 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.132524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69fcff-5a72-4481-90e0-947d802b4b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.150280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-bc69fcff-5a72-4481-90e0-947d802b4b09 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:51.151495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-bc69fcff-5a72-4481-90e0-947d802b4b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:51.173112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.173812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.174100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.174379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.175138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.177070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.211394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1123/2232] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:51 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:51.213362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.215046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:51.222998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1110/2233] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:51.231212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59004-90d7-4756-bf3e-89b1842c285c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.231617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59004-90d7-4756-bf3e-89b1842c285c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.231899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e59004-90d7-4756-bf3e-89b1842c285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.255101 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f1e59004-90d7-4756-bf3e-89b1842c285c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:51.256304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f1e59004-90d7-4756-bf3e-89b1842c285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:51.289642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8a4af-03f9-41b0-9c1f-1feea8da772c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.297599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfffec6-4c0c-41ad-8356-7de532c4bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.298286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfffec6-4c0c-41ad-8356-7de532c4bbfd admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.298583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfffec6-4c0c-41ad-8356-7de532c4bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.298893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfffec6-4c0c-41ad-8356-7de532c4bbfd admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.299767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfffec6-4c0c-41ad-8356-7de532c4bbfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.302000 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfffec6-4c0c-41ad-8356-7de532c4bbfd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.325328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1124/2234] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:51 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:51.327875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1111/2235] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:51.329346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfffec6-4c0c-41ad-8356-7de532c4bbfd admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.335158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59004-90d7-4756-bf3e-89b1842c285c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.340635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfffec6-4c0c-41ad-8356-7de532c4bbfd admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.343235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e59004-90d7-4756-bf3e-89b1842c285c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.345337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbefb5-610f-4149-a3c5-3d0390922486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.346148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbefb5-610f-4149-a3c5-3d0390922486 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.346482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbefb5-610f-4149-a3c5-3d0390922486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.346695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbefb5-610f-4149-a3c5-3d0390922486 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.347414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbefb5-610f-4149-a3c5-3d0390922486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.349528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbefb5-610f-4149-a3c5-3d0390922486 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.352310 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.352967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.353754 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.354061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.356056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:39:51.356533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.358887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.363022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1125/2236] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:39:51.368702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbefb5-610f-4149-a3c5-3d0390922486 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.382416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1112/2237] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:39:51.382416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.385952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbefb5-610f-4149-a3c5-3d0390922486 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.392060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20435174-6e6e-4768-ae57-c9b675e86743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.394031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff608be-f64c-4918-9f50-c1b9d81cc1a7 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.395986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20435174-6e6e-4768-ae57-c9b675e86743 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.396293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20435174-6e6e-4768-ae57-c9b675e86743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.396661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20435174-6e6e-4768-ae57-c9b675e86743 admin admin] PATH_INFO: `/v3/projects/ca95ca96fa8c46c5860bc1b3a9e57c65/users/979bb1c89d494b5eb8ae11c344309ffc/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.400763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393bdb4-8d50-4099-9d96-d7f09f08bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.401824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bdb4-8d50-4099-9d96-d7f09f08bd47 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.402154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bdb4-8d50-4099-9d96-d7f09f08bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.403034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bdb4-8d50-4099-9d96-d7f09f08bd47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.403809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393bdb4-8d50-4099-9d96-d7f09f08bd47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.406176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393bdb4-8d50-4099-9d96-d7f09f08bd47 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.420456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20435174-6e6e-4768-ae57-c9b675e86743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca95ca96fa8c46c5860bc1b3a9e57c65, user_id=979bb1c89d494b5eb8ae11c344309ffc, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.420456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20435174-6e6e-4768-ae57-c9b675e86743 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.434754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1126/2238] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:51 2022] PUT /identity/v3/projects/ca95ca96fa8c46c5860bc1b3a9e57c65/users/979bb1c89d494b5eb8ae11c344309ffc/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:51.438598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20435174-6e6e-4768-ae57-c9b675e86743 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.438896 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1113/2239] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:39:51 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:39:51.443981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393bdb4-8d50-4099-9d96-d7f09f08bd47 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.517474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393bdb4-8d50-4099-9d96-d7f09f08bd47 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.519457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20435174-6e6e-4768-ae57-c9b675e86743 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.522504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3460ef-66ae-438d-a72d-f27e0aee0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.523249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3460ef-66ae-438d-a72d-f27e0aee0fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.523987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3460ef-66ae-438d-a72d-f27e0aee0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.523987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3460ef-66ae-438d-a72d-f27e0aee0fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.524668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3460ef-66ae-438d-a72d-f27e0aee0fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.526207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22040070-92be-4af5-8030-c6e88e7d4aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.526748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3460ef-66ae-438d-a72d-f27e0aee0fb3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.527819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22040070-92be-4af5-8030-c6e88e7d4aac admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.528182 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22040070-92be-4af5-8030-c6e88e7d4aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.528532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22040070-92be-4af5-8030-c6e88e7d4aac admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.529347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22040070-92be-4af5-8030-c6e88e7d4aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.531181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22040070-92be-4af5-8030-c6e88e7d4aac admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.542498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1127/2240] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:51.546835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22040070-92be-4af5-8030-c6e88e7d4aac admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.549025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1114/2241] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:39:51 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:39:51.555555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3460ef-66ae-438d-a72d-f27e0aee0fb3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.563439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22040070-92be-4af5-8030-c6e88e7d4aac admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.566907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3460ef-66ae-438d-a72d-f27e0aee0fb3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.569359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70f489-23db-4c87-a39f-a44ad8725915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.570346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f489-23db-4c87-a39f-a44ad8725915 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.570697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f489-23db-4c87-a39f-a44ad8725915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.571522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70f489-23db-4c87-a39f-a44ad8725915 admin admin] PATH_INFO: `/v3/projects/ca95ca96fa8c46c5860bc1b3a9e57c65/users/979bb1c89d494b5eb8ae11c344309ffc/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.572328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a815f-0a45-4c9c-96ad-e53762e697db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.573140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a815f-0a45-4c9c-96ad-e53762e697db admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.573490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a815f-0a45-4c9c-96ad-e53762e697db admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.573739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70f489-23db-4c87-a39f-a44ad8725915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca95ca96fa8c46c5860bc1b3a9e57c65, user_id=979bb1c89d494b5eb8ae11c344309ffc, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.573929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a815f-0a45-4c9c-96ad-e53762e697db admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.575430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a815f-0a45-4c9c-96ad-e53762e697db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.576982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a815f-0a45-4c9c-96ad-e53762e697db admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.577507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70f489-23db-4c87-a39f-a44ad8725915 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.591316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1115/2242] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:51.591508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1128/2243] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:51 2022] PUT /identity/v3/projects/ca95ca96fa8c46c5860bc1b3a9e57c65/users/979bb1c89d494b5eb8ae11c344309ffc/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:39:51.592561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a815f-0a45-4c9c-96ad-e53762e697db admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.601491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06ea1d-932e-4a4a-963c-90d864efa425 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.601814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06ea1d-932e-4a4a-963c-90d864efa425 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.602087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06ea1d-932e-4a4a-963c-90d864efa425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.604752 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a815f-0a45-4c9c-96ad-e53762e697db admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.636583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-1d06ea1d-932e-4a4a-963c-90d864efa425 None None] MFA Rules not processed for user `979bb1c89d494b5eb8ae11c344309ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:51.638408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1d06ea1d-932e-4a4a-963c-90d864efa425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:51.706501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aeec2-5c32-494f-bb8a-133ce73ac0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.707196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aeec2-5c32-494f-bb8a-133ce73ac0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.707481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aeec2-5c32-494f-bb8a-133ce73ac0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.707757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aeec2-5c32-494f-bb8a-133ce73ac0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.708527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aeec2-5c32-494f-bb8a-133ce73ac0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.710185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aeec2-5c32-494f-bb8a-133ce73ac0e6 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.722105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1116/2244] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:39:51.727035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aeec2-5c32-494f-bb8a-133ce73ac0e6 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.728325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1129/2245] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:51 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:39:51.738633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aeec2-5c32-494f-bb8a-133ce73ac0e6 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.740778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06ea1d-932e-4a4a-963c-90d864efa425 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.742209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1d06ea1d-932e-4a4a-963c-90d864efa425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:51.744208 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c779fd-7863-4c4b-b733-254e774b37c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.746729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c779fd-7863-4c4b-b733-254e774b37c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.747093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c779fd-7863-4c4b-b733-254e774b37c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.747446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c779fd-7863-4c4b-b733-254e774b37c4 admin admin] PATH_INFO: `/v3/projects/612b57e71e0f48a1a05e157ab84232d8/users/68f74d08daa94c35ad77c1a23f15f041/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.768205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c779fd-7863-4c4b-b733-254e774b37c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612b57e71e0f48a1a05e157ab84232d8, user_id=68f74d08daa94c35ad77c1a23f15f041, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:51.771060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c779fd-7863-4c4b-b733-254e774b37c4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:51.789617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1117/2246] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:39:51 2022] PUT /identity/v3/projects/612b57e71e0f48a1a05e157ab84232d8/users/68f74d08daa94c35ad77c1a23f15f041/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:39:51.801833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e77a-47c6-497c-83ad-0f2c5170f62e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.802380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e77a-47c6-497c-83ad-0f2c5170f62e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.802888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172e77a-47c6-497c-83ad-0f2c5170f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.847131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b172e77a-47c6-497c-83ad-0f2c5170f62e None None] MFA Rules not processed for user `68f74d08daa94c35ad77c1a23f15f041`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:39:51.848335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b172e77a-47c6-497c-83ad-0f2c5170f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:51.882356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06ea1d-932e-4a4a-963c-90d864efa425 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.946174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1118/2247] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:39:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:39:51.958962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.960757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172e77a-47c6-497c-83ad-0f2c5170f62e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:51.962328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b172e77a-47c6-497c-83ad-0f2c5170f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:51.963929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.964212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.964487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:51.979908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172e77a-47c6-497c-83ad-0f2c5170f62e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:51.990546 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b3b82-dcd2-4bdf-a1b4-a1c6c1fb3b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:51.991217 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b3b82-dcd2-4bdf-a1b4-a1c6c1fb3b5c service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:51.991516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b3b82-dcd2-4bdf-a1b4-a1c6c1fb3b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:51.991785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b3b82-dcd2-4bdf-a1b4-a1c6c1fb3b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:52.002003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b3b82-dcd2-4bdf-a1b4-a1c6c1fb3b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:52.005867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b3b82-dcd2-4bdf-a1b4-a1c6c1fb3b5c service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:52.016112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1119/2248] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:52.061259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:52.062998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:52.073490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1130/2249] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:51 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:39:52.161571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b3b82-dcd2-4bdf-a1b4-a1c6c1fb3b5c service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:39:52.175026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b3b82-dcd2-4bdf-a1b4-a1c6c1fb3b5c service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:39:52.179297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:39:52.179968 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:39:52.180257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:39:52.180529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:39:52.182657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:39:52.255643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:39:52.256863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:39:52.267486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1120/2250] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:39:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:13.223056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:13.224476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.297795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a3cc-ef9d-413c-89e4-d3a7cee893d7 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:13.302696 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:13.303678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.303843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.304112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] PATH_INFO: `/v3/users/e39b48a7673547b295932d8938b702c3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.305903 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39b48a7673547b295932d8938b702c3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:13.309355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:13.365762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:13.367515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.370309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39b48a7673547b295932d8938b702c3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.383277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39b48a7673547b295932d8938b702c3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.385674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011d669-5993-4f07-90c5-fcce2612a09e service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:13.390320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39b48a7673547b295932d8938b702c3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.390799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:13.390995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39b48a7673547b295932d8938b702c3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.391655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.391934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.392203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] PATH_INFO: `/v3/users/a903015316ce4954bf11e556e8517832` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.393362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a903015316ce4954bf11e556e8517832)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:13.395332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:13.399359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39b48a7673547b295932d8938b702c3'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.405380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1131/2251] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:13 2022] DELETE /identity/v3/users/e39b48a7673547b295932d8938b702c3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:13.406217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:13.407499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.446051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a903015316ce4954bf11e556e8517832'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.458328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a903015316ce4954bf11e556e8517832'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.459067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a903015316ce4954bf11e556e8517832'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.465745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a903015316ce4954bf11e556e8517832'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.466378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-76616caa-eddd-4faf-965f-026280ef4a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a903015316ce4954bf11e556e8517832'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.473419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cea67-f5c9-48c0-af24-946b13431dbd admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:13.479545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:13.479687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1121/2252] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:13 2022] DELETE /identity/v3/users/a903015316ce4954bf11e556e8517832 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:40:13.479770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.480498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.484517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] PATH_INFO: `/v3/users/b46ca46b12284e919c15a1782dec32f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.484668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a63c-6f42-4e70-9fbc-1a48ec077321 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.484668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a63c-6f42-4e70-9fbc-1a48ec077321 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.484668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a63c-6f42-4e70-9fbc-1a48ec077321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.484953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46ca46b12284e919c15a1782dec32f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:13.485954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:13.499932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2244a63c-6f42-4e70-9fbc-1a48ec077321 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:13.501209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2244a63c-6f42-4e70-9fbc-1a48ec077321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.534413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46ca46b12284e919c15a1782dec32f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.547335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46ca46b12284e919c15a1782dec32f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.554371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46ca46b12284e919c15a1782dec32f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.555086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46ca46b12284e919c15a1782dec32f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.562276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46ca46b12284e919c15a1782dec32f6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:13.562434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1122/2253] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:13.563745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061778-1e66-4853-bbef-4f81705472a7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.564034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061778-1e66-4853-bbef-4f81705472a7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.564311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061778-1e66-4853-bbef-4f81705472a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.575802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1132/2254] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:13 2022] DELETE /identity/v3/users/b46ca46b12284e919c15a1782dec32f6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:13.576672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:13.578037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.582238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c4061778-1e66-4853-bbef-4f81705472a7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:13.583412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c4061778-1e66-4853-bbef-4f81705472a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.632164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7ba4-e611-45be-ae3e-a7080b00d3a2 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:13.635764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:13.636432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.636710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.637013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.638813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.640047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1123/2255] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:13.641141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d7c93-6088-4a3f-abf8-e876c985c820 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.641431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d7c93-6088-4a3f-abf8-e876c985c820 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.641796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d7c93-6088-4a3f-abf8-e876c985c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.651736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:13.653203 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:13.658461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-107d7c93-6088-4a3f-abf8-e876c985c820 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:13.659651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-107d7c93-6088-4a3f-abf8-e876c985c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.662584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1133/2256] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:13.663431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:13.670516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1124/2257] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:13.671994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d301a-e96d-40a8-9ae5-3d75aa725f35 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:13.676064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:13.676702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.676905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d7c93-6088-4a3f-abf8-e876c985c820 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:13.677005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.677239 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.678311 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-107d7c93-6088-4a3f-abf8-e876c985c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:13.687634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:13.689189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:13.690502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d7c93-6088-4a3f-abf8-e876c985c820 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:13.694527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:13.695171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:13.695461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:13.695757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:13.699756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1134/2258] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:13.705358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:13.706990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:13.716543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1125/2259] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:40:14.046132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.047599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.060825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098ebb5-6a4f-42d0-a45b-735eaa5ab69b service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.067361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.068246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.068505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.068773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] PATH_INFO: `/v3/projects/74ee77bf795c49f3ba59fe139702c9e2` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.070025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ee77bf795c49f3ba59fe139702c9e2)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.072360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.088562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.090839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.111376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6969e6-7754-4832-aae4-98bf2db4b315 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.117674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.118656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.119056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.119400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] PATH_INFO: `/v3/projects/a820f412a2924c43831407fffcd86d8b` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.120810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a820f412a2924c43831407fffcd86d8b)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.123084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.133769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ee77bf795c49f3ba59fe139702c9e2', 'request_id': 'req-c87b185a-bc17-4dfb-b4b3-3f886891356b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.140090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ee77bf795c49f3ba59fe139702c9e2', 'request_id': 'req-c87b185a-bc17-4dfb-b4b3-3f886891356b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.147611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ee77bf795c49f3ba59fe139702c9e2', 'request_id': 'req-c87b185a-bc17-4dfb-b4b3-3f886891356b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.159473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] The token cache is being invalidate because project 74ee77bf795c49f3ba59fe139702c9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:14.159873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.160497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.162064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1135/2260] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:14 2022] DELETE /identity/v3/projects/74ee77bf795c49f3ba59fe139702c9e2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:14.162960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.164312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.176964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a820f412a2924c43831407fffcd86d8b', 'request_id': 'req-ee759d86-729a-48d5-a7ff-f29e16c59ba0'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.182501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a820f412a2924c43831407fffcd86d8b', 'request_id': 'req-ee759d86-729a-48d5-a7ff-f29e16c59ba0'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.191098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a820f412a2924c43831407fffcd86d8b', 'request_id': 'req-ee759d86-729a-48d5-a7ff-f29e16c59ba0'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.206200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] The token cache is being invalidate because project a820f412a2924c43831407fffcd86d8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:14.206489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.207141 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ee759d86-729a-48d5-a7ff-f29e16c59ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.208698 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1126/2261] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:14 2022] DELETE /identity/v3/projects/a820f412a2924c43831407fffcd86d8b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:14.210824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d402-8447-472b-b24b-e396a4733c75 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.211222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d402-8447-472b-b24b-e396a4733c75 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.211824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d402-8447-472b-b24b-e396a4733c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.231008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-e702d402-8447-472b-b24b-e396a4733c75 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:14.232377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e702d402-8447-472b-b24b-e396a4733c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.233673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b185a-bc17-4dfb-b4b3-3f886891356b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.294297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1127/2262] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:14.295166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702d402-8447-472b-b24b-e396a4733c75 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.296503 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e702d402-8447-472b-b24b-e396a4733c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.299773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.300981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.301390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.301815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] PATH_INFO: `/v3/projects/74239c7bf10042db8dfd06985396562c` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.303236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74239c7bf10042db8dfd06985396562c)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.305593 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.308035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702d402-8447-472b-b24b-e396a4733c75 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.312753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.313657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.314022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.314274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] PATH_INFO: `/v3/users/979bb1c89d494b5eb8ae11c344309ffc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.315610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979bb1c89d494b5eb8ae11c344309ffc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.317816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.358546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74239c7bf10042db8dfd06985396562c', 'request_id': 'req-0ddd098f-69f8-4775-bca0-9108faaa4d89'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.363818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74239c7bf10042db8dfd06985396562c', 'request_id': 'req-0ddd098f-69f8-4775-bca0-9108faaa4d89'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.365387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979bb1c89d494b5eb8ae11c344309ffc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.372122 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74239c7bf10042db8dfd06985396562c', 'request_id': 'req-0ddd098f-69f8-4775-bca0-9108faaa4d89'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.380412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979bb1c89d494b5eb8ae11c344309ffc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.381267 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979bb1c89d494b5eb8ae11c344309ffc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.387589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] The token cache is being invalidate because project 74239c7bf10042db8dfd06985396562c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:14.387989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.388908 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ddd098f-69f8-4775-bca0-9108faaa4d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.390148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979bb1c89d494b5eb8ae11c344309ffc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.394199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1136/2263] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:14 2022] DELETE /identity/v3/projects/74239c7bf10042db8dfd06985396562c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:14.394537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-45f688e2-28ce-44bb-9f6a-5772b9502af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979bb1c89d494b5eb8ae11c344309ffc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.394703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b9e1b-d01e-4a45-a3b1-a9614b241cb2 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.394703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b9e1b-d01e-4a45-a3b1-a9614b241cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.394703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b9e1b-d01e-4a45-a3b1-a9614b241cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.410030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1128/2264] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:14 2022] DELETE /identity/v3/users/979bb1c89d494b5eb8ae11c344309ffc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:14.414971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686dd0-b029-4c5f-aaad-decf5e2fbeb7 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.415541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686dd0-b029-4c5f-aaad-decf5e2fbeb7 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.415965 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686dd0-b029-4c5f-aaad-decf5e2fbeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.417641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d09b9e1b-d01e-4a45-a3b1-a9614b241cb2 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:14.419210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d09b9e1b-d01e-4a45-a3b1-a9614b241cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.439231 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3c686dd0-b029-4c5f-aaad-decf5e2fbeb7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:14.440530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3c686dd0-b029-4c5f-aaad-decf5e2fbeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.522960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1137/2265] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:14.527872 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b9e1b-d01e-4a45-a3b1-a9614b241cb2 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.533906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1129/2266] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:14.537312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1c47-5452-4a95-81e8-4f6938b4d404 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.537619 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1c47-5452-4a95-81e8-4f6938b4d404 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.537897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1c47-5452-4a95-81e8-4f6938b4d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.540175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b9e1b-d01e-4a45-a3b1-a9614b241cb2 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.545745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.546435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.546853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.547722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.548010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:40:14.548317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.550298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.556843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d0af1c47-5452-4a95-81e8-4f6938b4d404 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:14.558717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d0af1c47-5452-4a95-81e8-4f6938b4d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.564467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1138/2267] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:40:14.567937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.573735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1130/2268] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:14.576894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1c47-5452-4a95-81e8-4f6938b4d404 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.586521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1c47-5452-4a95-81e8-4f6938b4d404 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.591017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e54b7-2687-4af0-8740-80dee074f9e9 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.592344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.593173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.593688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.594126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.595005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:40:14.595458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.596886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942a206-2096-4b6d-8617-8af6f2e75819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.597628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a206-2096-4b6d-8617-8af6f2e75819 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.597882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.598016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a206-2096-4b6d-8617-8af6f2e75819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.598184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942a206-2096-4b6d-8617-8af6f2e75819 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.598876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942a206-2096-4b6d-8617-8af6f2e75819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.600898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942a206-2096-4b6d-8617-8af6f2e75819 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.611171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1131/2269] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:40:14.616322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.630626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c273e-c938-475f-b9c1-0f39f3bc2a16 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.633713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1139/2270] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:14.636114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942a206-2096-4b6d-8617-8af6f2e75819 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.698040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a5c3-3c68-487a-a26a-02b707c3b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.699298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a5c3-3c68-487a-a26a-02b707c3b756 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.699778 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a5c3-3c68-487a-a26a-02b707c3b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.700155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a5c3-3c68-487a-a26a-02b707c3b756 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.700889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a5c3-3c68-487a-a26a-02b707c3b756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.703490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a5c3-3c68-487a-a26a-02b707c3b756 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.706146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942a206-2096-4b6d-8617-8af6f2e75819 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.716473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.717200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.717482 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.717786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.718486 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.720445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.738969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1132/2271] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:14.741791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1140/2272] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:14.743034 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a5c3-3c68-487a-a26a-02b707c3b756 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.743148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.747490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.759498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc05c79-7762-4e1e-adeb-a9cb50acc434 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.805219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a5c3-3c68-487a-a26a-02b707c3b756 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.810555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b91d88-14c4-44e3-bed6-586ac73284af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.811159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91d88-14c4-44e3-bed6-586ac73284af admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.811447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91d88-14c4-44e3-bed6-586ac73284af admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.811718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91d88-14c4-44e3-bed6-586ac73284af admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.812398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b91d88-14c4-44e3-bed6-586ac73284af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.814358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b91d88-14c4-44e3-bed6-586ac73284af admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.814543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.815402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.815681 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.815977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] PATH_INFO: `/v3/projects/ca95ca96fa8c46c5860bc1b3a9e57c65` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.817407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca95ca96fa8c46c5860bc1b3a9e57c65)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.819345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.840339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1133/2273] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:40:14.841384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b91d88-14c4-44e3-bed6-586ac73284af admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.856512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b91d88-14c4-44e3-bed6-586ac73284af admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.868854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca95ca96fa8c46c5860bc1b3a9e57c65', 'request_id': 'req-1adfb198-fa86-4b67-84e2-3d31bfa4190f'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.874890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca95ca96fa8c46c5860bc1b3a9e57c65', 'request_id': 'req-1adfb198-fa86-4b67-84e2-3d31bfa4190f'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.881742 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca95ca96fa8c46c5860bc1b3a9e57c65', 'request_id': 'req-1adfb198-fa86-4b67-84e2-3d31bfa4190f'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.893087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] The token cache is being invalidate because project ca95ca96fa8c46c5860bc1b3a9e57c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:14.893372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.894046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:14.895580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1141/2274] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:14 2022] DELETE /identity/v3/projects/ca95ca96fa8c46c5860bc1b3a9e57c65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:14.896406 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.897718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.916921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bce06-e03d-449f-a31d-f5550ae217dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.918145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bce06-e03d-449f-a31d-f5550ae217dc admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.918433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bce06-e03d-449f-a31d-f5550ae217dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.918747 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bce06-e03d-449f-a31d-f5550ae217dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.920083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bce06-e03d-449f-a31d-f5550ae217dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.921886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bce06-e03d-449f-a31d-f5550ae217dc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.931908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1134/2275] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:14.933004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6529e5-1d7b-468c-8491-f3640d2b5b65 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.933983 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6529e5-1d7b-468c-8491-f3640d2b5b65 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.934266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6529e5-1d7b-468c-8491-f3640d2b5b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.952941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1a6529e5-1d7b-468c-8491-f3640d2b5b65 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:14.954174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1a6529e5-1d7b-468c-8491-f3640d2b5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.961972 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1135/2276] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:14.962737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6529e5-1d7b-468c-8491-f3640d2b5b65 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:14.963971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfb198-fa86-4b67-84e2-3d31bfa4190f admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.964098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1a6529e5-1d7b-468c-8491-f3640d2b5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:14.971930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ff2f-dcc4-4467-8eb8-f45e4e03d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.972659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ff2f-dcc4-4467-8eb8-f45e4e03d3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.972944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ff2f-dcc4-4467-8eb8-f45e4e03d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.973219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ff2f-dcc4-4467-8eb8-f45e4e03d3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.974009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032ff2f-dcc4-4467-8eb8-f45e4e03d3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.975621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032ff2f-dcc4-4467-8eb8-f45e4e03d3f3 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.975893 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6529e5-1d7b-468c-8491-f3640d2b5b65 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:14.981464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563bf54-2d9e-4d13-bbd9-ddab285d8630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:14.982254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563bf54-2d9e-4d13-bbd9-ddab285d8630 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.982638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563bf54-2d9e-4d13-bbd9-ddab285d8630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.983010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563bf54-2d9e-4d13-bbd9-ddab285d8630 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.983887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563bf54-2d9e-4d13-bbd9-ddab285d8630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:14.985473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563bf54-2d9e-4d13-bbd9-ddab285d8630 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:14.987116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1142/2277] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:14.988388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910575-0f6e-4396-95e2-9f121d810936 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:14.988676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910575-0f6e-4396-95e2-9f121d810936 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:14.989080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910575-0f6e-4396-95e2-9f121d810936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:14.999152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1136/2278] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:15.000259 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563bf54-2d9e-4d13-bbd9-ddab285d8630 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.007184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-5e910575-0f6e-4396-95e2-9f121d810936 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:15.008371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5e910575-0f6e-4396-95e2-9f121d810936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.009937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563bf54-2d9e-4d13-bbd9-ddab285d8630 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.014427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686095-f970-4f98-aed2-1a8829cf00ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.015103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686095-f970-4f98-aed2-1a8829cf00ec admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.015387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686095-f970-4f98-aed2-1a8829cf00ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.015660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686095-f970-4f98-aed2-1a8829cf00ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.016369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686095-f970-4f98-aed2-1a8829cf00ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.019692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1143/2279] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:15.019692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910575-0f6e-4396-95e2-9f121d810936 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.019890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686095-f970-4f98-aed2-1a8829cf00ec admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.028366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1137/2280] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:15.028663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910575-0f6e-4396-95e2-9f121d810936 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.029164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686095-f970-4f98-aed2-1a8829cf00ec admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.035233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfae3c-186d-4960-ad26-d425a8144abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.036103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfae3c-186d-4960-ad26-d425a8144abb admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.036386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfae3c-186d-4960-ad26-d425a8144abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.036660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfae3c-186d-4960-ad26-d425a8144abb admin admin] PATH_INFO: `/v3/projects/52d2912ac6b246969f6f8876640df799/users/e57ff58f90374aeeb6666a539161a3c4/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.038381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686095-f970-4f98-aed2-1a8829cf00ec admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.043403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.044023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.044302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.044577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.045287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:40:15.045617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.047398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.052369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfae3c-186d-4960-ad26-d425a8144abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d2912ac6b246969f6f8876640df799, user_id=e57ff58f90374aeeb6666a539161a3c4, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.055050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfae3c-186d-4960-ad26-d425a8144abb admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.059633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1138/2281] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:40:15.060385 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.070029 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89966bb-ce92-4af5-a602-e64cd1b37697 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.071878 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1144/2282] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:15 2022] PUT /identity/v3/projects/52d2912ac6b246969f6f8876640df799/users/e57ff58f90374aeeb6666a539161a3c4/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:15.072823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfae3c-186d-4960-ad26-d425a8144abb admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.132299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4df8b-6d24-4dc0-af39-f1c285726287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.133180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4df8b-6d24-4dc0-af39-f1c285726287 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.133469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4df8b-6d24-4dc0-af39-f1c285726287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.133773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4df8b-6d24-4dc0-af39-f1c285726287 admin admin] PATH_INFO: `/v3/projects/70e0fc25f309475d83688bab2b138157/users/2a3cf6ced4ed4d4e87cb9934f020b055/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.137994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfae3c-186d-4960-ad26-d425a8144abb admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.142613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0e519-8f9d-4368-ab44-88e62b578c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.143382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0e519-8f9d-4368-ab44-88e62b578c50 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.143667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0e519-8f9d-4368-ab44-88e62b578c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.143940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0e519-8f9d-4368-ab44-88e62b578c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.144616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0e519-8f9d-4368-ab44-88e62b578c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.146548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0e519-8f9d-4368-ab44-88e62b578c50 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.147606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4df8b-6d24-4dc0-af39-f1c285726287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e0fc25f309475d83688bab2b138157, user_id=2a3cf6ced4ed4d4e87cb9934f020b055, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.150280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4df8b-6d24-4dc0-af39-f1c285726287 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.166308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1139/2283] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:15 2022] PUT /identity/v3/projects/70e0fc25f309475d83688bab2b138157/users/2a3cf6ced4ed4d4e87cb9934f020b055/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:15.168264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b138-f64c-42db-8bd7-6dd12ce593b6 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.168551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b138-f64c-42db-8bd7-6dd12ce593b6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.168841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b138-f64c-42db-8bd7-6dd12ce593b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.179922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1145/2284] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:15.179922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65a72-a148-4844-a535-7acbbc590766 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.179922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65a72-a148-4844-a535-7acbbc590766 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.179922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65a72-a148-4844-a535-7acbbc590766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.196024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b788b138-f64c-42db-8bd7-6dd12ce593b6 None None] MFA Rules not processed for user `e57ff58f90374aeeb6666a539161a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:15.197212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b788b138-f64c-42db-8bd7-6dd12ce593b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.197899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-5ee65a72-a148-4844-a535-7acbbc590766 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:15.199467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5ee65a72-a148-4844-a535-7acbbc590766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.261200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1146/2285] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:15.262743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee65a72-a148-4844-a535-7acbbc590766 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.264522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1140/2286] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:15.271721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788b138-f64c-42db-8bd7-6dd12ce593b6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.272460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee65a72-a148-4844-a535-7acbbc590766 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.273532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b788b138-f64c-42db-8bd7-6dd12ce593b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.277225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.277911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.278193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.278465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.279157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.281214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.304506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1147/2287] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:15.304506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.306150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.333340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788b138-f64c-42db-8bd7-6dd12ce593b6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.337559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f932a-10a4-449b-bbbe-517698f8dde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.338236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f932a-10a4-449b-bbbe-517698f8dde5 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.338520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f932a-10a4-449b-bbbe-517698f8dde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.338795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f932a-10a4-449b-bbbe-517698f8dde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.352886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f932a-10a4-449b-bbbe-517698f8dde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.354405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f932a-10a4-449b-bbbe-517698f8dde5 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.367888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1141/2288] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:40:15.368726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f932a-10a4-449b-bbbe-517698f8dde5 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.378309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f932a-10a4-449b-bbbe-517698f8dde5 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.383582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5d093-615c-4706-b21e-822904d20794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.384246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5d093-615c-4706-b21e-822904d20794 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.384531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5d093-615c-4706-b21e-822904d20794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.384805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5d093-615c-4706-b21e-822904d20794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.385531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5d093-615c-4706-b21e-822904d20794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.387207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5d093-615c-4706-b21e-822904d20794 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.391510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db951412-e246-43d5-bcef-1d1d53541e3b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.395921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ebdc6-1535-4595-a0f4-63aca33be5d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.396568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ebdc6-1535-4595-a0f4-63aca33be5d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.396856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ebdc6-1535-4595-a0f4-63aca33be5d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.397192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ebdc6-1535-4595-a0f4-63aca33be5d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.401370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1142/2289] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:15.403307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5d093-615c-4706-b21e-822904d20794 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.410873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ebdc6-1535-4595-a0f4-63aca33be5d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.413063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ebdc6-1535-4595-a0f4-63aca33be5d1 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.413786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5d093-615c-4706-b21e-822904d20794 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.419334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be0e41-571b-44cc-8f64-7b7246f23625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.420007 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0e41-571b-44cc-8f64-7b7246f23625 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.420923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0e41-571b-44cc-8f64-7b7246f23625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.421215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be0e41-571b-44cc-8f64-7b7246f23625 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.421990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be0e41-571b-44cc-8f64-7b7246f23625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.424243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be0e41-571b-44cc-8f64-7b7246f23625 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.426416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1148/2290] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:15.436805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1143/2291] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:15.442649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ebdc6-1535-4595-a0f4-63aca33be5d1 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.454408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ebdc6-1535-4595-a0f4-63aca33be5d1 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.459287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571f723-c190-4015-b814-32deddce4b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.460337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f723-c190-4015-b814-32deddce4b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.460753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f723-c190-4015-b814-32deddce4b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.461099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571f723-c190-4015-b814-32deddce4b74 admin admin] PATH_INFO: `/v3/projects/847706ade66549d1bb773dba85832447/users/a854788df5364d97b6be238bb0f5b659/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.468654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be0e41-571b-44cc-8f64-7b7246f23625 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.479545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be0e41-571b-44cc-8f64-7b7246f23625 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.491429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571f723-c190-4015-b814-32deddce4b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847706ade66549d1bb773dba85832447, user_id=a854788df5364d97b6be238bb0f5b659, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.493159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.494291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.494408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571f723-c190-4015-b814-32deddce4b74 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.495123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.495591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] PATH_INFO: `/v3/users/e57ff58f90374aeeb6666a539161a3c4` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.498487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e57ff58f90374aeeb6666a539161a3c4)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.501044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.510897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1149/2292] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:15 2022] PUT /identity/v3/projects/847706ade66549d1bb773dba85832447/users/a854788df5364d97b6be238bb0f5b659/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:15.526339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca830-9f85-48f1-bc28-5fc8a3c31446 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.526629 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca830-9f85-48f1-bc28-5fc8a3c31446 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.527431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca830-9f85-48f1-bc28-5fc8a3c31446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.576279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e57ff58f90374aeeb6666a539161a3c4'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.580636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ec2ca830-9f85-48f1-bc28-5fc8a3c31446 None None] MFA Rules not processed for user `a854788df5364d97b6be238bb0f5b659`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:15.581879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ec2ca830-9f85-48f1-bc28-5fc8a3c31446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.592575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e57ff58f90374aeeb6666a539161a3c4'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.593572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e57ff58f90374aeeb6666a539161a3c4'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.602877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e57ff58f90374aeeb6666a539161a3c4'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.604199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e57ff58f90374aeeb6666a539161a3c4'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.632108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1144/2293] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:15 2022] DELETE /identity/v3/users/e57ff58f90374aeeb6666a539161a3c4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:15.633285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.635283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.680185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1150/2294] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:15.684790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd834b-0817-4b47-9ead-55bc3bd216b4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.685084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd834b-0817-4b47-9ead-55bc3bd216b4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.685360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd834b-0817-4b47-9ead-55bc3bd216b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.706008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-64cd834b-0817-4b47-9ead-55bc3bd216b4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:15.707720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-64cd834b-0817-4b47-9ead-55bc3bd216b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.738110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5877-43d4-4bf4-adc7-56debd9964c0 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.744810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.745802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.746083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.746492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] PATH_INFO: `/v3/users/68f74d08daa94c35ad77c1a23f15f041` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.748341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f74d08daa94c35ad77c1a23f15f041)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.750842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.782648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1151/2295] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:15.783585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd834b-0817-4b47-9ead-55bc3bd216b4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.784943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-64cd834b-0817-4b47-9ead-55bc3bd216b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.798003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd834b-0817-4b47-9ead-55bc3bd216b4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.803686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.804466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.804659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.804900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.805662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.808275 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.810114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f74d08daa94c35ad77c1a23f15f041'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.822449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f74d08daa94c35ad77c1a23f15f041'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.824234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f74d08daa94c35ad77c1a23f15f041'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.833792 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f74d08daa94c35ad77c1a23f15f041'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.834509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f74d08daa94c35ad77c1a23f15f041'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:15.838454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1152/2296] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:15.838454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.840370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.856906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1145/2297] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:15 2022] DELETE /identity/v3/users/68f74d08daa94c35ad77c1a23f15f041 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:15.857904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:15.859388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.924106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9bae9-919b-4462-a882-a533f932f859 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.959027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d624948-49f5-4a0d-aef9-91541f0d9a82 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:15.965335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264eb60-38fe-42b7-a65b-92cd8adf2ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.966038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264eb60-38fe-42b7-a65b-92cd8adf2ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.966410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264eb60-38fe-42b7-a65b-92cd8adf2ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.966714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264eb60-38fe-42b7-a65b-92cd8adf2ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.967552 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264eb60-38fe-42b7-a65b-92cd8adf2ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:15.969511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264eb60-38fe-42b7-a65b-92cd8adf2ba4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:15.983601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:15.984346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.984697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.985051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:15.987029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:15.991238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1146/2298] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:15.995591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f275c-a331-4aa3-acf5-af9c84fe8c93 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:15.995881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f275c-a331-4aa3-acf5-af9c84fe8c93 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:15.996156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f275c-a331-4aa3-acf5-af9c84fe8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.001382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.003505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.014491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1153/2299] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:16.014661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-cb7f275c-a331-4aa3-acf5-af9c84fe8c93 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:16.015990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-cb7f275c-a331-4aa3-acf5-af9c84fe8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.018574 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.024286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1147/2300] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:16.032142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcf5ef-c12e-4c6d-8f21-df36951d75ee service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.037205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.037942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.038222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.038493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.039220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.040832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.054725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1154/2301] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:16.056349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f275c-a331-4aa3-acf5-af9c84fe8c93 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.061024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.063180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.070328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f275c-a331-4aa3-acf5-af9c84fe8c93 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.077996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c0bad-a23c-45da-94c7-553090b38ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.078680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0bad-a23c-45da-94c7-553090b38ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.078966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0bad-a23c-45da-94c7-553090b38ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.079241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c0bad-a23c-45da-94c7-553090b38ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.079980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c0bad-a23c-45da-94c7-553090b38ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.081631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c0bad-a23c-45da-94c7-553090b38ccd admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.089743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6019a-bb28-4de1-a7c9-90259b2f5b33 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.095656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1148/2302] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:16.096033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225912b2-a6ef-4250-b8e9-37263a797422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.097100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225912b2-a6ef-4250-b8e9-37263a797422 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.097388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225912b2-a6ef-4250-b8e9-37263a797422 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.097785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225912b2-a6ef-4250-b8e9-37263a797422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.100694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c0bad-a23c-45da-94c7-553090b38ccd admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.112172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225912b2-a6ef-4250-b8e9-37263a797422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.113264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c0bad-a23c-45da-94c7-553090b38ccd admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.113801 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225912b2-a6ef-4250-b8e9-37263a797422 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.119053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b552a-f4ff-475b-a0e1-e87a7fba619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.121906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b552a-f4ff-475b-a0e1-e87a7fba619b admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.122359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b552a-f4ff-475b-a0e1-e87a7fba619b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.122702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b552a-f4ff-475b-a0e1-e87a7fba619b admin admin] PATH_INFO: `/v3/projects/f38767a6d6cd4f48884ed79e33a66711/users/25d7d7d04584471399e827a1ac03f884/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.125811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1155/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:16.141182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b552a-f4ff-475b-a0e1-e87a7fba619b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38767a6d6cd4f48884ed79e33a66711, user_id=25d7d7d04584471399e827a1ac03f884, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.144175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b552a-f4ff-475b-a0e1-e87a7fba619b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.162079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1149/2304] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:16 2022] PUT /identity/v3/projects/f38767a6d6cd4f48884ed79e33a66711/users/25d7d7d04584471399e827a1ac03f884/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:16.172587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9ada0-42db-4312-9d06-98da4e0a8deb None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.172946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9ada0-42db-4312-9d06-98da4e0a8deb None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.173341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9ada0-42db-4312-9d06-98da4e0a8deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.208612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e1b9ada0-42db-4312-9d06-98da4e0a8deb None None] MFA Rules not processed for user `25d7d7d04584471399e827a1ac03f884`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:16.209858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e1b9ada0-42db-4312-9d06-98da4e0a8deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.310823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad711fb-5745-44c1-b88d-643ce3a77001 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.311114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad711fb-5745-44c1-b88d-643ce3a77001 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.311396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad711fb-5745-44c1-b88d-643ce3a77001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.330737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1156/2305] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:16.334067 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9ada0-42db-4312-9d06-98da4e0a8deb None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.370005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1ad711fb-5745-44c1-b88d-643ce3a77001 None None] MFA Rules not processed for user `2a3cf6ced4ed4d4e87cb9934f020b055`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:16.371788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1ad711fb-5745-44c1-b88d-643ce3a77001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.427004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9ada0-42db-4312-9d06-98da4e0a8deb None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.431998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.432900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.434000 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.434436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.435335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.437897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.482767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1157/2306] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:16 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:16.485375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.490664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.508341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1150/2307] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:40:16.509582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad711fb-5745-44c1-b88d-643ce3a77001 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.532072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad711fb-5745-44c1-b88d-643ce3a77001 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.596605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b379b68-f68d-4845-a2f5-38041abd8cf5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.601575 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.602452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.602733 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.603013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] PATH_INFO: `/v3/projects/52d2912ac6b246969f6f8876640df799` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.604202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d2912ac6b246969f6f8876640df799)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.606772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.622975 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.623785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.624354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.624530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.625341 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.627391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.652023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1151/2308] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:16 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:16.652023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.652023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.660169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d2912ac6b246969f6f8876640df799', 'request_id': 'req-147e5962-3c82-4521-b57a-d4152f34ba36'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.666013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d2912ac6b246969f6f8876640df799', 'request_id': 'req-147e5962-3c82-4521-b57a-d4152f34ba36'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.675123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d2912ac6b246969f6f8876640df799', 'request_id': 'req-147e5962-3c82-4521-b57a-d4152f34ba36'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.688815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] The token cache is being invalidate because project 52d2912ac6b246969f6f8876640df799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:16.689110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.689805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.691813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1158/2309] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:16 2022] DELETE /identity/v3/projects/52d2912ac6b246969f6f8876640df799 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:16.694317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.698611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.715656 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20d18-14f9-48d8-b0e4-da066534db74 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.764547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e5962-3c82-4521-b57a-d4152f34ba36 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.768368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.769097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.769573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.769958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.770091 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.770948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.771228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.771496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] PATH_INFO: `/v3/projects/612b57e71e0f48a1a05e157ab84232d8` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.772357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.772863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=612b57e71e0f48a1a05e157ab84232d8)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.774934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.823158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612b57e71e0f48a1a05e157ab84232d8', 'request_id': 'req-b1b44493-8654-41bc-9246-8e7acd57c5a6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.828650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612b57e71e0f48a1a05e157ab84232d8', 'request_id': 'req-b1b44493-8654-41bc-9246-8e7acd57c5a6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.835976 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612b57e71e0f48a1a05e157ab84232d8', 'request_id': 'req-b1b44493-8654-41bc-9246-8e7acd57c5a6'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.841419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.842894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:16.850638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] The token cache is being invalidate because project 612b57e71e0f48a1a05e157ab84232d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:16.850859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.851503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b1b44493-8654-41bc-9246-8e7acd57c5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:16.852121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1152/2310] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:16.852924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:16.854224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.855023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1159/2311] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:16 2022] DELETE /identity/v3/projects/612b57e71e0f48a1a05e157ab84232d8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:16.865103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26dfd-a8f5-49a1-8553-f63d92cdfde1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.865103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26dfd-a8f5-49a1-8553-f63d92cdfde1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.865103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e26dfd-a8f5-49a1-8553-f63d92cdfde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.884262 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d33a50-7217-4262-ba08-fef4805e5b06 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:16.887073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-16e26dfd-a8f5-49a1-8553-f63d92cdfde1 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:16.888382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-16e26dfd-a8f5-49a1-8553-f63d92cdfde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:16.967320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1160/2312] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:16.975397 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689b1f-95bc-4073-b247-4e7e5d1a417a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.976267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689b1f-95bc-4073-b247-4e7e5d1a417a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.977072 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689b1f-95bc-4073-b247-4e7e5d1a417a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.983070 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:16.983870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:16.984165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:16.984447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:16.986233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:16.988824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.002851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1153/2313] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:17.003701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.003999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-da689b1f-95bc-4073-b247-4e7e5d1a417a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:17.005526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:17.006043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-da689b1f-95bc-4073-b247-4e7e5d1a417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:17.017971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1161/2314] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:40:17.022484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da689b1f-95bc-4073-b247-4e7e5d1a417a None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.023390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e461c-404b-418e-9f03-cca6b6edf040 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.033314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49459a-2da2-4cc0-bbba-fdffdaf07efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.035212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da689b1f-95bc-4073-b247-4e7e5d1a417a None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.035346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49459a-2da2-4cc0-bbba-fdffdaf07efa admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.035564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49459a-2da2-4cc0-bbba-fdffdaf07efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.035848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49459a-2da2-4cc0-bbba-fdffdaf07efa admin admin] PATH_INFO: `/v3/projects/eede880326494e08b7286f4bb5730e67/users/6d3f2d22107c486682a596d26612dd26/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.041520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.043261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.043915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.044293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.045578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:40:17.045729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.047537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.065773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1162/2315] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:40:17.065954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49459a-2da2-4cc0-bbba-fdffdaf07efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eede880326494e08b7286f4bb5730e67, user_id=6d3f2d22107c486682a596d26612dd26, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.067707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49459a-2da2-4cc0-bbba-fdffdaf07efa admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.068778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.080572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869c9af-02d8-44ae-9b99-a3b547f76c28 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.083412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1154/2316] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:17 2022] PUT /identity/v3/projects/eede880326494e08b7286f4bb5730e67/users/6d3f2d22107c486682a596d26612dd26/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:17.087386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49459a-2da2-4cc0-bbba-fdffdaf07efa admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.141823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a655d1-f524-4e23-ad32-256bbd3ff2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.142496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a655d1-f524-4e23-ad32-256bbd3ff2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.142751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a655d1-f524-4e23-ad32-256bbd3ff2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.143020 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a655d1-f524-4e23-ad32-256bbd3ff2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.143703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a655d1-f524-4e23-ad32-256bbd3ff2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.145632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a655d1-f524-4e23-ad32-256bbd3ff2c4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.160923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49459a-2da2-4cc0-bbba-fdffdaf07efa admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.166772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105883-cc79-49f6-88f7-3cc60e0333ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.168287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105883-cc79-49f6-88f7-3cc60e0333ef admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.168779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105883-cc79-49f6-88f7-3cc60e0333ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.169255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105883-cc79-49f6-88f7-3cc60e0333ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.170126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a105883-cc79-49f6-88f7-3cc60e0333ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.171971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a105883-cc79-49f6-88f7-3cc60e0333ef admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.184193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1155/2317] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:40:17.187844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105883-cc79-49f6-88f7-3cc60e0333ef admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.195625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1163/2318] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:17 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:17.199084 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a655d1-f524-4e23-ad32-256bbd3ff2c4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.199799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105883-cc79-49f6-88f7-3cc60e0333ef admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.260772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7d086-66e3-4ef7-824a-28670bbed323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.262215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7d086-66e3-4ef7-824a-28670bbed323 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.262499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7d086-66e3-4ef7-824a-28670bbed323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.262776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7d086-66e3-4ef7-824a-28670bbed323 admin admin] PATH_INFO: `/v3/projects/eede880326494e08b7286f4bb5730e67/users/6d3f2d22107c486682a596d26612dd26/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.264768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7d086-66e3-4ef7-824a-28670bbed323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eede880326494e08b7286f4bb5730e67, user_id=6d3f2d22107c486682a596d26612dd26, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.267492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7d086-66e3-4ef7-824a-28670bbed323 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.268403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a655d1-f524-4e23-ad32-256bbd3ff2c4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.273651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9b50-51c4-49b0-aa9e-521c4dbbfe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.274470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9b50-51c4-49b0-aa9e-521c4dbbfe6e admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.274934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9b50-51c4-49b0-aa9e-521c4dbbfe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.275243 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc9b50-51c4-49b0-aa9e-521c4dbbfe6e admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.275925 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc9b50-51c4-49b0-aa9e-521c4dbbfe6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.278566 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc9b50-51c4-49b0-aa9e-521c4dbbfe6e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.278795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1156/2319] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:17 2022] PUT /identity/v3/projects/eede880326494e08b7286f4bb5730e67/users/6d3f2d22107c486682a596d26612dd26/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:17.290329 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302783fd-502c-4361-a76d-e67623688d83 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.290626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302783fd-502c-4361-a76d-e67623688d83 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.290909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302783fd-502c-4361-a76d-e67623688d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.297351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1164/2320] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:17 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:40:17.301246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9b50-51c4-49b0-aa9e-521c4dbbfe6e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.310726 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc9b50-51c4-49b0-aa9e-521c4dbbfe6e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.318204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-302783fd-502c-4361-a76d-e67623688d83 None None] MFA Rules not processed for user `6d3f2d22107c486682a596d26612dd26`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:17.319415 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-302783fd-502c-4361-a76d-e67623688d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:17.366701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b264a-1644-43cb-b62b-b8516c10788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.367454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b264a-1644-43cb-b62b-b8516c10788d admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.367736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b264a-1644-43cb-b62b-b8516c10788d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.368013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b264a-1644-43cb-b62b-b8516c10788d admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.368736 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b264a-1644-43cb-b62b-b8516c10788d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.370369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b264a-1644-43cb-b62b-b8516c10788d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.379967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1165/2321] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:40:17.383814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b264a-1644-43cb-b62b-b8516c10788d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.385584 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1157/2322] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:40:17.397931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b264a-1644-43cb-b62b-b8516c10788d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.398174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302783fd-502c-4361-a76d-e67623688d83 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.399525 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-302783fd-502c-4361-a76d-e67623688d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:17.403171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d59a6-8309-4a55-a84f-9371fe5f4643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.403826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d59a6-8309-4a55-a84f-9371fe5f4643 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.404114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d59a6-8309-4a55-a84f-9371fe5f4643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.404424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d59a6-8309-4a55-a84f-9371fe5f4643 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.405147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d59a6-8309-4a55-a84f-9371fe5f4643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.406782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d59a6-8309-4a55-a84f-9371fe5f4643 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.419606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1166/2323] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:40:17.420887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d59a6-8309-4a55-a84f-9371fe5f4643 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.430233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d59a6-8309-4a55-a84f-9371fe5f4643 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.434871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e9d7b-8692-4df1-b9fe-ef2e073d9a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.435719 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9d7b-8692-4df1-b9fe-ef2e073d9a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.436003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9d7b-8692-4df1-b9fe-ef2e073d9a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.436280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9d7b-8692-4df1-b9fe-ef2e073d9a83 admin admin] PATH_INFO: `/v3/projects/d69ae02f1e0146c795d799160ac17d44/users/ed2dae16f03c4eff9185087ed50120fc/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.451140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e9d7b-8692-4df1-b9fe-ef2e073d9a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69ae02f1e0146c795d799160ac17d44, user_id=ed2dae16f03c4eff9185087ed50120fc, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.453871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e9d7b-8692-4df1-b9fe-ef2e073d9a83 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.455376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302783fd-502c-4361-a76d-e67623688d83 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.459536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.460277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.460648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.460928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.468252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1167/2324] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:17 2022] PUT /identity/v3/projects/d69ae02f1e0146c795d799160ac17d44/users/ed2dae16f03c4eff9185087ed50120fc/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:17.471135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.472670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.472975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d4ba2-c0e5-483f-9bbb-c2fa0ef6dd74 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.473313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d4ba2-c0e5-483f-9bbb-c2fa0ef6dd74 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.473672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d4ba2-c0e5-483f-9bbb-c2fa0ef6dd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.484705 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1158/2325] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:40:17.491739 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-050d4ba2-c0e5-483f-9bbb-c2fa0ef6dd74 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:17.492970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-050d4ba2-c0e5-483f-9bbb-c2fa0ef6dd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:17.525815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.527805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:17.539907 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385d496-cd95-48c3-8bd1-4ddb34dc227f service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.552641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1168/2326] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:40:17.562842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d4ba2-c0e5-483f-9bbb-c2fa0ef6dd74 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:17.564225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-050d4ba2-c0e5-483f-9bbb-c2fa0ef6dd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:17.590226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.590938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.591229 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.591539 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.593448 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:17.620131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d4ba2-c0e5-483f-9bbb-c2fa0ef6dd74 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:17.624559 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c368c4-e739-4057-a624-2dc2b646dcb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:17.625288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c368c4-e739-4057-a624-2dc2b646dcb3 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:17.625589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c368c4-e739-4057-a624-2dc2b646dcb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:17.625861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c368c4-e739-4057-a624-2dc2b646dcb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:17.634677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c368c4-e739-4057-a624-2dc2b646dcb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.636020 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c368c4-e739-4057-a624-2dc2b646dcb3 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.645773 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1169/2327] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:40:17.651513 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:17.653059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:17.662379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1159/2328] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:40:18.275419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389edb-6db4-4588-9023-3cae4246ca5a None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:18.275796 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389edb-6db4-4588-9023-3cae4246ca5a None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:18.276176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389edb-6db4-4588-9023-3cae4246ca5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:18.294665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-83389edb-6db4-4588-9023-3cae4246ca5a None None] MFA Rules not processed for user `2a3cf6ced4ed4d4e87cb9934f020b055`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:18.295882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-83389edb-6db4-4588-9023-3cae4246ca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:18.358228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1170/2329] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:20.700803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:20.711234 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05539909-0799-497f-869c-ebf75b66e305 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:20.715835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:20.716765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:20.717163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:20.717504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] PATH_INFO: `/v3/users/a854788df5364d97b6be238bb0f5b659` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:20.718814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a854788df5364d97b6be238bb0f5b659)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:20.720798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:20.783081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a854788df5364d97b6be238bb0f5b659'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:20.798776 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a854788df5364d97b6be238bb0f5b659'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:20.799013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a854788df5364d97b6be238bb0f5b659'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:20.806278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a854788df5364d97b6be238bb0f5b659'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:20.806959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a854788df5364d97b6be238bb0f5b659'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:20.830942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1160/2330] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:20 2022] DELETE /identity/v3/users/a854788df5364d97b6be238bb0f5b659 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:20.833162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb90c8b-4793-4412-92b3-7d28b2a55d95 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:20.833995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb90c8b-4793-4412-92b3-7d28b2a55d95 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:20.834425 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb90c8b-4793-4412-92b3-7d28b2a55d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:20.855588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9eb90c8b-4793-4412-92b3-7d28b2a55d95 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:20.857315 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9eb90c8b-4793-4412-92b3-7d28b2a55d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:20.946413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1171/2331] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:20.952699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:20.954323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:21.017492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317870d0-6f15-491a-815f-4e282caa39b3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:21.021986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4dc5f-7e05-486e-b903-d7c4e7951f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:21.022643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4dc5f-7e05-486e-b903-d7c4e7951f18 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:21.022980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4dc5f-7e05-486e-b903-d7c4e7951f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:21.023264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4dc5f-7e05-486e-b903-d7c4e7951f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:21.035577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4dc5f-7e05-486e-b903-d7c4e7951f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:21.037040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4dc5f-7e05-486e-b903-d7c4e7951f18 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:21.049527 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1161/2332] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:40:21.807405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb90c8b-4793-4412-92b3-7d28b2a55d95 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:21.809049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9eb90c8b-4793-4412-92b3-7d28b2a55d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:21.822331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb90c8b-4793-4412-92b3-7d28b2a55d95 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:21.827797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:21.828772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:21.828941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:21.829219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] PATH_INFO: `/v3/projects/847706ade66549d1bb773dba85832447` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:21.830476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847706ade66549d1bb773dba85832447)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:21.832404 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:21.902819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847706ade66549d1bb773dba85832447', 'request_id': 'req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:21.911174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847706ade66549d1bb773dba85832447', 'request_id': 'req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:21.922789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847706ade66549d1bb773dba85832447', 'request_id': 'req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:21.937972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] The token cache is being invalidate because project 847706ade66549d1bb773dba85832447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:21.938808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:21.939764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:21.942690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1172/2333] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:21 2022] DELETE /identity/v3/projects/847706ade66549d1bb773dba85832447 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:21.946754 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4dc5f-7e05-486e-b903-d7c4e7951f18 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:21.960861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4dc5f-7e05-486e-b903-d7c4e7951f18 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:22.105820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:22.106845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:22.107222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:22.107504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] PATH_INFO: `/v3/users/25d7d7d04584471399e827a1ac03f884` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:22.112410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d7d7d04584471399e827a1ac03f884)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:22.116063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:22.184813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d7d7d04584471399e827a1ac03f884'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.199890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d7d7d04584471399e827a1ac03f884'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.201613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d7d7d04584471399e827a1ac03f884'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.208657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d7d7d04584471399e827a1ac03f884'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.209478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d7d7d04584471399e827a1ac03f884'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.225170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1162/2334] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:21 2022] DELETE /identity/v3/users/25d7d7d04584471399e827a1ac03f884 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:22.611873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:22.622474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:22.649001 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8c4f6-d31e-4415-81fe-6f0a3ba92492 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:22.799165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:22.801902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:22.802372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:22.802813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] PATH_INFO: `/v3/projects/f38767a6d6cd4f48884ed79e33a66711` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:22.804686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38767a6d6cd4f48884ed79e33a66711)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:22.807066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:22.875047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38767a6d6cd4f48884ed79e33a66711', 'request_id': 'req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.887474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38767a6d6cd4f48884ed79e33a66711', 'request_id': 'req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.897973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38767a6d6cd4f48884ed79e33a66711', 'request_id': 'req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.947479 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] The token cache is being invalidate because project f38767a6d6cd4f48884ed79e33a66711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:22.948497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.949502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a36bb816-6c7a-47b0-a5b8-7c2d9c5423ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:22.955221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1173/2335] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:22 2022] DELETE /identity/v3/projects/f38767a6d6cd4f48884ed79e33a66711 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:22.956323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:22.957998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:22.979193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c49b-5414-4edd-a696-deaeb2c56f04 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:23.064064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:23.065223 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:23.065689 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:23.066843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] PATH_INFO: `/v3/users/6d3f2d22107c486682a596d26612dd26` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:23.069075 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3f2d22107c486682a596d26612dd26)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:23.071502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:23.187585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3f2d22107c486682a596d26612dd26'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:23.210841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3f2d22107c486682a596d26612dd26'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:23.211884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3f2d22107c486682a596d26612dd26'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:23.221321 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3f2d22107c486682a596d26612dd26'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:23.222391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3f2d22107c486682a596d26612dd26'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:23.246350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1163/2336] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:22 2022] DELETE /identity/v3/users/6d3f2d22107c486682a596d26612dd26 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:40:23.678497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff1159-00b4-48af-9001-2b34586c37c1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:23.678815 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff1159-00b4-48af-9001-2b34586c37c1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:23.679102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff1159-00b4-48af-9001-2b34586c37c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:23.710202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-dbff1159-00b4-48af-9001-2b34586c37c1 None None] MFA Rules not processed for user `ed2dae16f03c4eff9185087ed50120fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:23.711428 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-dbff1159-00b4-48af-9001-2b34586c37c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:23.774606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1174/2337] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:23.779086 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:23.780508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:23.850842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027bc6b-9a24-4201-b1a5-17d2426bcd5f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:23.857272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:23.857451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:23.857724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:23.858009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:23.858727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:23.860612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:23.892180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1164/2338] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:23 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:23.896483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff1159-00b4-48af-9001-2b34586c37c1 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:23.909379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff1159-00b4-48af-9001-2b34586c37c1 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:23.912457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:23.914550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:24.008492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f61b2-13ab-4b68-9679-5015ff9898a3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.015129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.016414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.016912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.017396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] PATH_INFO: `/v3/projects/eede880326494e08b7286f4bb5730e67` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.019064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eede880326494e08b7286f4bb5730e67)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.023149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.024199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ef657-4485-4273-aed2-f0e77f9039dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.024886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ef657-4485-4273-aed2-f0e77f9039dd admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.025209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ef657-4485-4273-aed2-f0e77f9039dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.025442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ef657-4485-4273-aed2-f0e77f9039dd admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.026174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ef657-4485-4273-aed2-f0e77f9039dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.028147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ef657-4485-4273-aed2-f0e77f9039dd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.060777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1175/2339] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:23 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:24.062412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ef657-4485-4273-aed2-f0e77f9039dd admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.074465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ef657-4485-4273-aed2-f0e77f9039dd admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.086254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eede880326494e08b7286f4bb5730e67', 'request_id': 'req-41bc2c56-64e7-4b04-9c0f-bbe310800b02'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:24.094192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eede880326494e08b7286f4bb5730e67', 'request_id': 'req-41bc2c56-64e7-4b04-9c0f-bbe310800b02'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:24.106862 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eede880326494e08b7286f4bb5730e67', 'request_id': 'req-41bc2c56-64e7-4b04-9c0f-bbe310800b02'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:24.147570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] The token cache is being invalidate because project eede880326494e08b7286f4bb5730e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:24.148222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:24.148901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-41bc2c56-64e7-4b04-9c0f-bbe310800b02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:24.149478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.150444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.150975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.151477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.152415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.154420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.160735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1165/2340] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:23 2022] DELETE /identity/v3/projects/eede880326494e08b7286f4bb5730e67 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:40:24.162350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5c438-1b72-4a16-9486-af2d412d7a68 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.163013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5c438-1b72-4a16-9486-af2d412d7a68 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.163306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5c438-1b72-4a16-9486-af2d412d7a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.165095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1176/2341] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:24.171113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.174949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:24.191532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39a31-6c8c-45c0-854a-2021c97d21ed admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.196903 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbea88-7a24-47cc-a6ed-b85d836e9683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.197998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbea88-7a24-47cc-a6ed-b85d836e9683 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.198519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbea88-7a24-47cc-a6ed-b85d836e9683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.198894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbea88-7a24-47cc-a6ed-b85d836e9683 admin admin] PATH_INFO: `/v3/projects/b4db4ccb6b824dfa84c1d1a6fd0d92e8/users/90ea3386eba440d49ff82f94022b9144/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.211056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8ab5c438-1b72-4a16-9486-af2d412d7a68 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:24.212327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8ab5c438-1b72-4a16-9486-af2d412d7a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:24.219649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbea88-7a24-47cc-a6ed-b85d836e9683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4db4ccb6b824dfa84c1d1a6fd0d92e8, user_id=90ea3386eba440d49ff82f94022b9144, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.221927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1166/2342] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:24.222703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbea88-7a24-47cc-a6ed-b85d836e9683 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.231339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f7db5-c2f2-415e-a841-b6ed1df5fdf5 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.231545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f7db5-c2f2-415e-a841-b6ed1df5fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.231811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f7db5-c2f2-415e-a841-b6ed1df5fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.248723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1177/2343] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:24 2022] PUT /identity/v3/projects/b4db4ccb6b824dfa84c1d1a6fd0d92e8/users/90ea3386eba440d49ff82f94022b9144/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:24.254647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbea88-7a24-47cc-a6ed-b85d836e9683 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.264547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c49f7db5-c2f2-415e-a841-b6ed1df5fdf5 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:24.264547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c49f7db5-c2f2-415e-a841-b6ed1df5fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:24.334807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1167/2344] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:24.339675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f7db5-c2f2-415e-a841-b6ed1df5fdf5 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.357303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbea88-7a24-47cc-a6ed-b85d836e9683 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.366385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b4e6-1194-4942-ab21-cf94c9c35a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.368203 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b4e6-1194-4942-ab21-cf94c9c35a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.369727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b4e6-1194-4942-ab21-cf94c9c35a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.370786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f7db5-c2f2-415e-a841-b6ed1df5fdf5 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.371634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b4e6-1194-4942-ab21-cf94c9c35a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.373100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3b4e6-1194-4942-ab21-cf94c9c35a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.376722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3b4e6-1194-4942-ab21-cf94c9c35a36 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.387187 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.387882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.388168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.388466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.389209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:40:24.390292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.394352 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.408860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1178/2345] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:24.409840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b4e6-1194-4942-ab21-cf94c9c35a36 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.443123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1168/2346] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:40:24.444030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.444831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b4e6-1194-4942-ab21-cf94c9c35a36 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.456524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe369aa-acf1-4a9f-ad5e-da58e278b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.457434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe369aa-acf1-4a9f-ad5e-da58e278b342 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.457745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe369aa-acf1-4a9f-ad5e-da58e278b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.458022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe369aa-acf1-4a9f-ad5e-da58e278b342 admin admin] PATH_INFO: `/v3/projects/b4db4ccb6b824dfa84c1d1a6fd0d92e8/users/90ea3386eba440d49ff82f94022b9144/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.461354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe369aa-acf1-4a9f-ad5e-da58e278b342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4db4ccb6b824dfa84c1d1a6fd0d92e8, user_id=90ea3386eba440d49ff82f94022b9144, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.468206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239fe93-0c6f-4ec1-adf2-3df256a483e3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.469832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe369aa-acf1-4a9f-ad5e-da58e278b342 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.482350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eddb3-f64b-4706-a689-eadcdf42343a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.483028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eddb3-f64b-4706-a689-eadcdf42343a admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.483312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eddb3-f64b-4706-a689-eadcdf42343a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.483586 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eddb3-f64b-4706-a689-eadcdf42343a admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.484283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eddb3-f64b-4706-a689-eadcdf42343a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.487941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eddb3-f64b-4706-a689-eadcdf42343a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.494419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1179/2347] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:24 2022] PUT /identity/v3/projects/b4db4ccb6b824dfa84c1d1a6fd0d92e8/users/90ea3386eba440d49ff82f94022b9144/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:24.552889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1169/2348] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:24 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:24.556986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe369aa-acf1-4a9f-ad5e-da58e278b342 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.689089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe369aa-acf1-4a9f-ad5e-da58e278b342 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.831829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d8355-f4f5-4cb8-a138-05f5a2176541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.832781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8355-f4f5-4cb8-a138-05f5a2176541 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.833348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8355-f4f5-4cb8-a138-05f5a2176541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.833843 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d8355-f4f5-4cb8-a138-05f5a2176541 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.835704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8355-f4f5-4cb8-a138-05f5a2176541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.838295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d8355-f4f5-4cb8-a138-05f5a2176541 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.867650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1180/2349] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:24 2022] POST /identity/v3/users => generated 280 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:24.872516 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eddb3-f64b-4706-a689-eadcdf42343a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.888790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eddb3-f64b-4706-a689-eadcdf42343a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.899563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf59c77-9794-43f4-a3ad-8331290754a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.900281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf59c77-9794-43f4-a3ad-8331290754a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.900911 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf59c77-9794-43f4-a3ad-8331290754a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.900911 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf59c77-9794-43f4-a3ad-8331290754a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.901650 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf59c77-9794-43f4-a3ad-8331290754a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.903797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf59c77-9794-43f4-a3ad-8331290754a2 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.918745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1170/2350] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:24.922078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d8355-f4f5-4cb8-a138-05f5a2176541 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.937765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d8355-f4f5-4cb8-a138-05f5a2176541 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.946296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05e8c7-b7ac-46cd-ba6e-cbe9377bcb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.947070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e8c7-b7ac-46cd-ba6e-cbe9377bcb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.947356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e8c7-b7ac-46cd-ba6e-cbe9377bcb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.947797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05e8c7-b7ac-46cd-ba6e-cbe9377bcb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:24.950354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05e8c7-b7ac-46cd-ba6e-cbe9377bcb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:24.953711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05e8c7-b7ac-46cd-ba6e-cbe9377bcb4e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:24.965922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1181/2351] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:24.970102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf59c77-9794-43f4-a3ad-8331290754a2 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:24.982330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf59c77-9794-43f4-a3ad-8331290754a2 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:24.987946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:24.988957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:24.989658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:24.990135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] PATH_INFO: `/v3/projects/f65b7348ccab42d48c4c837c8a498544/users/90fb4cf6fb4544e08e07f129b5522d81/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:25.009932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65b7348ccab42d48c4c837c8a498544, user_id=90fb4cf6fb4544e08e07f129b5522d81, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:25.013379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:25.034807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1171/2352] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:24 2022] PUT /identity/v3/projects/f65b7348ccab42d48c4c837c8a498544/users/90fb4cf6fb4544e08e07f129b5522d81/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:40:25.046907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba742-d1f1-4411-a222-3359b2d3fe41 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:25.047394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba742-d1f1-4411-a222-3359b2d3fe41 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:25.047394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba742-d1f1-4411-a222-3359b2d3fe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:25.081347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e6dba742-d1f1-4411-a222-3359b2d3fe41 None None] MFA Rules not processed for user `90fb4cf6fb4544e08e07f129b5522d81`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:25.082660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e6dba742-d1f1-4411-a222-3359b2d3fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:25.194013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1182/2353] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:25 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:25.231048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:25.233048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:25.322728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a288b3-0f05-457e-a4bf-0613916d2581 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:25.333109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7ef10-f272-46bd-b32c-df66ce4166d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:25.333852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7ef10-f272-46bd-b32c-df66ce4166d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:25.334610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7ef10-f272-46bd-b32c-df66ce4166d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:25.334895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7ef10-f272-46bd-b32c-df66ce4166d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:25.348176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7ef10-f272-46bd-b32c-df66ce4166d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:25.350995 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7ef10-f272-46bd-b32c-df66ce4166d1 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:25.363624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1172/2354] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:25 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:25.382582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dba742-d1f1-4411-a222-3359b2d3fe41 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:25.466897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dba742-d1f1-4411-a222-3359b2d3fe41 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:25.471529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:25.472408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:25.472688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:25.472958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] PATH_INFO: `/v3/users/90fb4cf6fb4544e08e07f129b5522d81` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:25.474180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90fb4cf6fb4544e08e07f129b5522d81)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:25.476217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:25.541679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90fb4cf6fb4544e08e07f129b5522d81'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:25.559862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90fb4cf6fb4544e08e07f129b5522d81'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:25.568891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90fb4cf6fb4544e08e07f129b5522d81'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:25.570188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90fb4cf6fb4544e08e07f129b5522d81'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:25.580321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90fb4cf6fb4544e08e07f129b5522d81'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:25.589716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1183/2355] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:25 2022] DELETE /identity/v3/users/90fb4cf6fb4544e08e07f129b5522d81 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:25.591399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3984bb-3bae-44a4-bef6-6e3117a11e14 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:25.591678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3984bb-3bae-44a4-bef6-6e3117a11e14 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:25.592013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3984bb-3bae-44a4-bef6-6e3117a11e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:25.613962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ba3984bb-3bae-44a4-bef6-6e3117a11e14 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:25.617009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ba3984bb-3bae-44a4-bef6-6e3117a11e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:25.714185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1173/2356] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:25.723667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:25.725662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:25.818816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e4b2-5e77-4e18-bba4-f7ecba275db8 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:25.829317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75132f9-2eff-41d9-b0c5-8346d16f808e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:25.831267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75132f9-2eff-41d9-b0c5-8346d16f808e service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:25.831497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75132f9-2eff-41d9-b0c5-8346d16f808e service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:25.833768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75132f9-2eff-41d9-b0c5-8346d16f808e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:25.855669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75132f9-2eff-41d9-b0c5-8346d16f808e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:25.859550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75132f9-2eff-41d9-b0c5-8346d16f808e service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:25.884955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1184/2357] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:26.538655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3984bb-3bae-44a4-bef6-6e3117a11e14 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:26.540125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ba3984bb-3bae-44a4-bef6-6e3117a11e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:26.560173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3984bb-3bae-44a4-bef6-6e3117a11e14 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:26.568353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:26.570483 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:26.570981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:26.571531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] PATH_INFO: `/v3/projects/f65b7348ccab42d48c4c837c8a498544` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:26.573233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65b7348ccab42d48c4c837c8a498544)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:26.577210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:26.678026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65b7348ccab42d48c4c837c8a498544', 'request_id': 'req-cf53822b-3951-4fc3-a328-59992f801d5e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:26.688406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65b7348ccab42d48c4c837c8a498544', 'request_id': 'req-cf53822b-3951-4fc3-a328-59992f801d5e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:26.705027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65b7348ccab42d48c4c837c8a498544', 'request_id': 'req-cf53822b-3951-4fc3-a328-59992f801d5e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:26.725701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] The token cache is being invalidate because project f65b7348ccab42d48c4c837c8a498544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:26.726248 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:26.727125 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-cf53822b-3951-4fc3-a328-59992f801d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:26.733918 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1174/2358] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:26 2022] DELETE /identity/v3/projects/f65b7348ccab42d48c4c837c8a498544 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:26.739316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0de6-4893-4b1f-89fa-5f2fb3744c59 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:26.740166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0de6-4893-4b1f-89fa-5f2fb3744c59 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:26.740588 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a0de6-4893-4b1f-89fa-5f2fb3744c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:26.777520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f71a0de6-4893-4b1f-89fa-5f2fb3744c59 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:26.780290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f71a0de6-4893-4b1f-89fa-5f2fb3744c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:26.871040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1185/2359] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:26.879826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50625c1-5b76-4287-9385-130dabe4d0f4 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:26.880112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50625c1-5b76-4287-9385-130dabe4d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:26.880390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50625c1-5b76-4287-9385-130dabe4d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:26.901762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b50625c1-5b76-4287-9385-130dabe4d0f4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:26.903664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b50625c1-5b76-4287-9385-130dabe4d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:26.920093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1175/2360] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:26.924355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0de6-4893-4b1f-89fa-5f2fb3744c59 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:26.937367 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a0de6-4893-4b1f-89fa-5f2fb3744c59 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:26.943521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:26.944202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:26.944481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:26.944753 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:26.945658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:40:26.945979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:26.947680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:26.966406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50625c1-5b76-4287-9385-130dabe4d0f4 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:26.973818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1186/2361] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:40:26.978997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50625c1-5b76-4287-9385-130dabe4d0f4 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:26.984841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6182e2-dfc2-432a-8afa-b59f3236a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:26.985508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6182e2-dfc2-432a-8afa-b59f3236a2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:26.985834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6182e2-dfc2-432a-8afa-b59f3236a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:26.986106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6182e2-dfc2-432a-8afa-b59f3236a2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:26.986927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6182e2-dfc2-432a-8afa-b59f3236a2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:26.988855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6182e2-dfc2-432a-8afa-b59f3236a2c4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:27.025596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1176/2362] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:40:26 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:27.031159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:27.071712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9353c7-6987-47d0-9ec2-e4843667812b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:27.191870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2e231-1f4f-434f-8331-6b1fc3c3571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:27.192834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e231-1f4f-434f-8331-6b1fc3c3571e admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:27.193185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e231-1f4f-434f-8331-6b1fc3c3571e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:27.193532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e231-1f4f-434f-8331-6b1fc3c3571e admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:27.194512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2e231-1f4f-434f-8331-6b1fc3c3571e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:27.196522 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2e231-1f4f-434f-8331-6b1fc3c3571e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:27.239861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1187/2363] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:40:27 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:40:27.243996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6182e2-dfc2-432a-8afa-b59f3236a2c4 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:27.258809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6182e2-dfc2-432a-8afa-b59f3236a2c4 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:27.273941 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252dff-f34c-4cec-86fa-e591934fcb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:27.274984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252dff-f34c-4cec-86fa-e591934fcb3e admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:27.275673 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252dff-f34c-4cec-86fa-e591934fcb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:27.276129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66252dff-f34c-4cec-86fa-e591934fcb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:27.277529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66252dff-f34c-4cec-86fa-e591934fcb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:27.280932 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66252dff-f34c-4cec-86fa-e591934fcb3e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:27.311487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1177/2364] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:27.313053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2e231-1f4f-434f-8331-6b1fc3c3571e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:27.329366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2e231-1f4f-434f-8331-6b1fc3c3571e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:27.342783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebb0c2-a0d7-419a-921e-54149babd10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:27.343922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb0c2-a0d7-419a-921e-54149babd10e admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:27.345095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb0c2-a0d7-419a-921e-54149babd10e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:27.345383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb0c2-a0d7-419a-921e-54149babd10e admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:27.347730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebb0c2-a0d7-419a-921e-54149babd10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:27.349449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebb0c2-a0d7-419a-921e-54149babd10e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:27.379308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1188/2365] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:40:27.380387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252dff-f34c-4cec-86fa-e591934fcb3e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:27.397789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66252dff-f34c-4cec-86fa-e591934fcb3e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:27.415732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:27.417059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:27.418134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:27.418816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] PATH_INFO: `/v3/projects/e281a5ed352441838b649ed98a4810df/users/75e9fc22cd0942ceb526726e66baec29/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:27.455589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e281a5ed352441838b649ed98a4810df, user_id=75e9fc22cd0942ceb526726e66baec29, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:27.462346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:27.507730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1178/2366] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:40:27 2022] PUT /identity/v3/projects/e281a5ed352441838b649ed98a4810df/users/75e9fc22cd0942ceb526726e66baec29/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:27.509805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136e01-2fa0-4a2a-9220-51f6a9ce351b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:27.510252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136e01-2fa0-4a2a-9220-51f6a9ce351b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:27.510790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15136e01-2fa0-4a2a-9220-51f6a9ce351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:27.574022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-15136e01-2fa0-4a2a-9220-51f6a9ce351b None None] MFA Rules not processed for user `75e9fc22cd0942ceb526726e66baec29`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:27.575939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-15136e01-2fa0-4a2a-9220-51f6a9ce351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:27.791847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1189/2367] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:27.817120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:27.821622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:27.963173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8272-6249-45c9-a0ea-6720cef7a482 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:27.975026 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92662516-3231-4d9a-8110-d2c18f06e594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:27.975729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92662516-3231-4d9a-8110-d2c18f06e594 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:27.976011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92662516-3231-4d9a-8110-d2c18f06e594 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:27.976393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92662516-3231-4d9a-8110-d2c18f06e594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:27.987970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92662516-3231-4d9a-8110-d2c18f06e594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:27.989674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92662516-3231-4d9a-8110-d2c18f06e594 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:28.003623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1179/2368] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:28.591818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490aa3c-b122-4a54-ba53-36636e680c4d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:28.592110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490aa3c-b122-4a54-ba53-36636e680c4d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:28.592394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490aa3c-b122-4a54-ba53-36636e680c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:28.629293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-2490aa3c-b122-4a54-ba53-36636e680c4d None None] MFA Rules not processed for user `cb70f7eb7b44487a9ee3f331c83f9e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:28.630803 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-2490aa3c-b122-4a54-ba53-36636e680c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:28.773532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1190/2369] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:29.726295 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb26a-ff55-443b-baf8-41d76d3d3eb0 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:29.726734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb26a-ff55-443b-baf8-41d76d3d3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:29.726734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb26a-ff55-443b-baf8-41d76d3d3eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:29.769771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-beceb26a-ff55-443b-baf8-41d76d3d3eb0 None None] MFA Rules not processed for user `75e9fc22cd0942ceb526726e66baec29`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:29.771010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-beceb26a-ff55-443b-baf8-41d76d3d3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:29.783372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1180/2370] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:32.159430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59377f5a-ea3a-461a-aad9-c23e24c22f4f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:32.159975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59377f5a-ea3a-461a-aad9-c23e24c22f4f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:32.159975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59377f5a-ea3a-461a-aad9-c23e24c22f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:32.199070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-59377f5a-ea3a-461a-aad9-c23e24c22f4f None None] MFA Rules not processed for user `90ea3386eba440d49ff82f94022b9144`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:32.200735 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-59377f5a-ea3a-461a-aad9-c23e24c22f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:32.288040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1191/2371] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:32.302365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceb26a-ff55-443b-baf8-41d76d3d3eb0 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:32.303779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-beceb26a-ff55-443b-baf8-41d76d3d3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:32.384888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceb26a-ff55-443b-baf8-41d76d3d3eb0 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:32.391102 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0218e-0b8b-411b-a2ba-088a0ba98d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:32.391954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0218e-0b8b-411b-a2ba-088a0ba98d7a service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:32.392398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0218e-0b8b-411b-a2ba-088a0ba98d7a service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:32.392821 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0218e-0b8b-411b-a2ba-088a0ba98d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:32.394992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-57d0218e-0b8b-411b-a2ba-088a0ba98d7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:32.465573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0218e-0b8b-411b-a2ba-088a0ba98d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:32.467202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0218e-0b8b-411b-a2ba-088a0ba98d7a service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:32.477638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1181/2372] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:42.650071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a77e2-95f6-42d8-9661-b83c51ac7f9b None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:42.651905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a77e2-95f6-42d8-9661-b83c51ac7f9b None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:42.652344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a77e2-95f6-42d8-9661-b83c51ac7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:42.684939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-098a77e2-95f6-42d8-9661-b83c51ac7f9b None None] MFA Rules not processed for user `2a3cf6ced4ed4d4e87cb9934f020b055`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:42.686180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-098a77e2-95f6-42d8-9661-b83c51ac7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:42.762258 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1192/2373] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:49.597330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14f8d0-d97c-4d67-8512-32a358d8559e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:49.597864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14f8d0-d97c-4d67-8512-32a358d8559e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:49.597957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14f8d0-d97c-4d67-8512-32a358d8559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:49.626148 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ee14f8d0-d97c-4d67-8512-32a358d8559e None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:49.627343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ee14f8d0-d97c-4d67-8512-32a358d8559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:49.705475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1182/2374] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:40:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:49.759099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a77e2-95f6-42d8-9661-b83c51ac7f9b None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:49.760626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-098a77e2-95f6-42d8-9661-b83c51ac7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:49.835312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a77e2-95f6-42d8-9661-b83c51ac7f9b None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:49.841480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96bd2-9745-435f-8cd6-aa3cd87096fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:49.842090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96bd2-9745-435f-8cd6-aa3cd87096fd service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:49.842375 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96bd2-9745-435f-8cd6-aa3cd87096fd service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:49.842650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96bd2-9745-435f-8cd6-aa3cd87096fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:49.851220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d96bd2-9745-435f-8cd6-aa3cd87096fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:49.852827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d96bd2-9745-435f-8cd6-aa3cd87096fd service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:49.861412 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1193/2375] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:40:50.428434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cfd8-a6a6-4e40-8c01-f8f5ce7650bb None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:50.428755 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cfd8-a6a6-4e40-8c01-f8f5ce7650bb None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:50.429036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1cfd8-a6a6-4e40-8c01-f8f5ce7650bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:50.447194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-84e1cfd8-a6a6-4e40-8c01-f8f5ce7650bb None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:50.448840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-84e1cfd8-a6a6-4e40-8c01-f8f5ce7650bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:50.455895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1183/2376] 10.222.0.36 () {58 vars in 967 bytes} [Wed May 11 07:40:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:50.469237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96bd2-9745-435f-8cd6-aa3cd87096fd service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:50.479414 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96bd2-9745-435f-8cd6-aa3cd87096fd service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:50.484332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3914f5-bbe3-41d0-90d7-f9f3d51c9684 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:50.484968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3914f5-bbe3-41d0-90d7-f9f3d51c9684 service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:50.485249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3914f5-bbe3-41d0-90d7-f9f3d51c9684 service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:50.485524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3914f5-bbe3-41d0-90d7-f9f3d51c9684 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:50.494053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3914f5-bbe3-41d0-90d7-f9f3d51c9684 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:50.495709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3914f5-bbe3-41d0-90d7-f9f3d51c9684 service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:50.503533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1194/2377] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:40:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:40:50.704711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae8069-5332-4f3a-a82a-efa09f54a0ee None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:50.705195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae8069-5332-4f3a-a82a-efa09f54a0ee None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:50.705296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae8069-5332-4f3a-a82a-efa09f54a0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:50.722226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0cae8069-5332-4f3a-a82a-efa09f54a0ee None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:50.723406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0cae8069-5332-4f3a-a82a-efa09f54a0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:50.730453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1184/2378] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:40:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:50.741972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3914f5-bbe3-41d0-90d7-f9f3d51c9684 service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:50.752867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3914f5-bbe3-41d0-90d7-f9f3d51c9684 service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:50.757901 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0988c-b10f-41f7-b6ca-e9fad8959dbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:50.758534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0988c-b10f-41f7-b6ca-e9fad8959dbd service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:50.758820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0988c-b10f-41f7-b6ca-e9fad8959dbd service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:50.759098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0988c-b10f-41f7-b6ca-e9fad8959dbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:50.767557 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0988c-b10f-41f7-b6ca-e9fad8959dbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:50.769136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0988c-b10f-41f7-b6ca-e9fad8959dbd service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:50.776888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1195/2379] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:40:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:40:51.150464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34615b9-d507-40a6-9f38-627da674f4e1 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:51.150758 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34615b9-d507-40a6-9f38-627da674f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:51.151033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34615b9-d507-40a6-9f38-627da674f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:51.169011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-b34615b9-d507-40a6-9f38-627da674f4e1 None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:51.170238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b34615b9-d507-40a6-9f38-627da674f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:51.177206 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1185/2380] 10.222.0.36 () {58 vars in 967 bytes} [Wed May 11 07:40:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:51.191079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0988c-b10f-41f7-b6ca-e9fad8959dbd service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:51.201639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0988c-b10f-41f7-b6ca-e9fad8959dbd service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:51.206563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04efa6-4fed-43fb-824f-6c549d6b19c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:51.207476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04efa6-4fed-43fb-824f-6c549d6b19c8 service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:51.207928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04efa6-4fed-43fb-824f-6c549d6b19c8 service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:51.208347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04efa6-4fed-43fb-824f-6c549d6b19c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:51.216800 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04efa6-4fed-43fb-824f-6c549d6b19c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:51.218723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04efa6-4fed-43fb-824f-6c549d6b19c8 service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:51.228139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1196/2381] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:40:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:40:51.684236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab0ad8-778e-4921-a5ad-8ffa94a4a41a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:51.684529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab0ad8-778e-4921-a5ad-8ffa94a4a41a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:51.684809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab0ad8-778e-4921-a5ad-8ffa94a4a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:51.705409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-95ab0ad8-778e-4921-a5ad-8ffa94a4a41a None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:51.706494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-95ab0ad8-778e-4921-a5ad-8ffa94a4a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:51.714405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1186/2382] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:40:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:51.726517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04efa6-4fed-43fb-824f-6c549d6b19c8 service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:51.736833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04efa6-4fed-43fb-824f-6c549d6b19c8 service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:51.741799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781ea77-d808-40fb-a8b1-fccf6b96fb89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:51.742427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ea77-d808-40fb-a8b1-fccf6b96fb89 service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:51.742710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ea77-d808-40fb-a8b1-fccf6b96fb89 service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:51.744786 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781ea77-d808-40fb-a8b1-fccf6b96fb89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:51.753850 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781ea77-d808-40fb-a8b1-fccf6b96fb89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:51.755434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781ea77-d808-40fb-a8b1-fccf6b96fb89 service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:51.764191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1197/2383] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:40:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:40:52.266350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c7a3-35e2-4041-a75f-65ff5d6959a9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:52.266992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c7a3-35e2-4041-a75f-65ff5d6959a9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:52.267471 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c7a3-35e2-4041-a75f-65ff5d6959a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:52.291184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-18b7c7a3-35e2-4041-a75f-65ff5d6959a9 None None] MFA Rules not processed for user `ed2dae16f03c4eff9185087ed50120fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:52.294619 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-18b7c7a3-35e2-4041-a75f-65ff5d6959a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:52.322890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1187/2384] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:53.815447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781ea77-d808-40fb-a8b1-fccf6b96fb89 service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:53.953897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781ea77-d808-40fb-a8b1-fccf6b96fb89 service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:53.966289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:53.967245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:53.967534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:53.967814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] PATH_INFO: `/v3/users/75e9fc22cd0942ceb526726e66baec29` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:53.969329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e9fc22cd0942ceb526726e66baec29)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:53.972023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:54.070706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e9fc22cd0942ceb526726e66baec29'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:54.088207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e9fc22cd0942ceb526726e66baec29'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:54.102846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e9fc22cd0942ceb526726e66baec29'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:54.105582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e9fc22cd0942ceb526726e66baec29'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:54.116132 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e9fc22cd0942ceb526726e66baec29'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:54.127112 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1198/2385] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:40:53 2022] DELETE /identity/v3/users/75e9fc22cd0942ceb526726e66baec29 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:40:54.132136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9c3f-3741-4e9d-90eb-a77cdba09da3 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:54.133035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9c3f-3741-4e9d-90eb-a77cdba09da3 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:54.133630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9c3f-3741-4e9d-90eb-a77cdba09da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:54.199991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-9cfb9c3f-3741-4e9d-90eb-a77cdba09da3 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:40:54.201757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9cfb9c3f-3741-4e9d-90eb-a77cdba09da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:54.278889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1188/2386] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:40:54.288553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:54.290304 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:54.398626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64b717-bd3f-4c75-84dc-559476349d53 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:54.405603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d4f4c-0885-46eb-8bad-1aea78be4bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:54.407033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4f4c-0885-46eb-8bad-1aea78be4bee service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:54.407536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4f4c-0885-46eb-8bad-1aea78be4bee service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:54.408046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d4f4c-0885-46eb-8bad-1aea78be4bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:54.420331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d4f4c-0885-46eb-8bad-1aea78be4bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:54.421217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d4f4c-0885-46eb-8bad-1aea78be4bee service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:54.433407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1199/2387] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:40:54.810568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb9c3f-3741-4e9d-90eb-a77cdba09da3 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:40:54.812598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-9cfb9c3f-3741-4e9d-90eb-a77cdba09da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:40:54.862617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb9c3f-3741-4e9d-90eb-a77cdba09da3 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:40:54.870923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:40:54.872321 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:40:54.872783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:40:54.873388 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] PATH_INFO: `/v3/projects/e281a5ed352441838b649ed98a4810df` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:40:54.875284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e281a5ed352441838b649ed98a4810df)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:40:54.877505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:40:55.049651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e281a5ed352441838b649ed98a4810df', 'request_id': 'req-a7f4d4c3-37c6-4540-aaea-885e6a646b54'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:55.049651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e281a5ed352441838b649ed98a4810df', 'request_id': 'req-a7f4d4c3-37c6-4540-aaea-885e6a646b54'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:55.069001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e281a5ed352441838b649ed98a4810df', 'request_id': 'req-a7f4d4c3-37c6-4540-aaea-885e6a646b54'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:55.082138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] The token cache is being invalidate because project e281a5ed352441838b649ed98a4810df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:40:55.082785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:55.083557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:40:55.085228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1189/2388] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:40:54 2022] DELETE /identity/v3/projects/e281a5ed352441838b649ed98a4810df => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:08.739572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c49863-67ce-49de-9c92-8d867386ae4f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:08.740141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c49863-67ce-49de-9c92-8d867386ae4f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:08.740141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c49863-67ce-49de-9c92-8d867386ae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:08.764140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-47c49863-67ce-49de-9c92-8d867386ae4f None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:08.765572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-47c49863-67ce-49de-9c92-8d867386ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:08.830136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1200/2389] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:41:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:08.842765 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:08.844655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:08.913594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4d4c3-37c6-4540-aaea-885e6a646b54 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:08.919035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88ebc8-07f3-42f1-b13c-c55092d559ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:08.919685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ebc8-07f3-42f1-b13c-c55092d559ae service swift] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:08.919971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ebc8-07f3-42f1-b13c-c55092d559ae service swift] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:08.920251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88ebc8-07f3-42f1-b13c-c55092d559ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:08.928120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88ebc8-07f3-42f1-b13c-c55092d559ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:08.929732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88ebc8-07f3-42f1-b13c-c55092d559ae service swift] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:08.938199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1190/2390] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:41:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:41:10.007161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc2c8-19d2-4c76-9f82-85c07f165bc0 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.007700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc2c8-19d2-4c76-9f82-85c07f165bc0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.007972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc2c8-19d2-4c76-9f82-85c07f165bc0 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.009430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1201/2391] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:41:10.029050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279e16a-792d-4cc5-b8a9-239cb6faa021 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.030072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279e16a-792d-4cc5-b8a9-239cb6faa021 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.030576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279e16a-792d-4cc5-b8a9-239cb6faa021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.112294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1279e16a-792d-4cc5-b8a9-239cb6faa021 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:10.113999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1279e16a-792d-4cc5-b8a9-239cb6faa021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:10.218031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1191/2392] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:10.230494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc2c8-19d2-4c76-9f82-85c07f165bc0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:10.232247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b91bc2c8-19d2-4c76-9f82-85c07f165bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:10.304842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc2c8-19d2-4c76-9f82-85c07f165bc0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:10.310806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e3647-3d39-44b2-b0a5-88d85156ecb6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91feeca74fe749fba52423aa28d48916', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:10.311653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e3647-3d39-44b2-b0a5-88d85156ecb6 service glance] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.312156 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e3647-3d39-44b2-b0a5-88d85156ecb6 service glance] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.312434 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e3647-3d39-44b2-b0a5-88d85156ecb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.327727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e3647-3d39-44b2-b0a5-88d85156ecb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:10.329443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e3647-3d39-44b2-b0a5-88d85156ecb6 service glance] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:10.341802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1202/2393] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:10.424606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36611bfa-7398-476a-965b-2b848e5e5b18 None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.430072 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36611bfa-7398-476a-965b-2b848e5e5b18 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.430763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36611bfa-7398-476a-965b-2b848e5e5b18 None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.435112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1192/2394] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:41:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:41:10.442155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd5e5-23df-4197-8eef-ffe88476feb4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.442707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd5e5-23df-4197-8eef-ffe88476feb4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.443256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd5e5-23df-4197-8eef-ffe88476feb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.474906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-075dd5e5-23df-4197-8eef-ffe88476feb4 None None] MFA Rules not processed for user `66b60e827f404e3891e4f24ca842e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:10.476749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-075dd5e5-23df-4197-8eef-ffe88476feb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:10.551968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1203/2395] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:41:10.570590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36611bfa-7398-476a-965b-2b848e5e5b18 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:10.574684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-36611bfa-7398-476a-965b-2b848e5e5b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:10.603337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36611bfa-7398-476a-965b-2b848e5e5b18 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:10.614960 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e00d8-4f36-451e-901a-e1f1e474fab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:10.615627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e00d8-4f36-451e-901a-e1f1e474fab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.615914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e00d8-4f36-451e-901a-e1f1e474fab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.616194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e00d8-4f36-451e-901a-e1f1e474fab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.631515 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e00d8-4f36-451e-901a-e1f1e474fab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:10.636615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e00d8-4f36-451e-901a-e1f1e474fab3 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:10.653338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1193/2396] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:10.821791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8d4c-fae4-4274-9d82-b9c28889955d None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.822403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8d4c-fae4-4274-9d82-b9c28889955d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.822846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8d4c-fae4-4274-9d82-b9c28889955d None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.824863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1204/2397] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:41:10.834770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb5cb-388d-438b-ba55-bdf9feddc3ca None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.835164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb5cb-388d-438b-ba55-bdf9feddc3ca None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.835537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb5cb-388d-438b-ba55-bdf9feddc3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.855238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-75dbb5cb-388d-438b-ba55-bdf9feddc3ca None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:10.856517 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-75dbb5cb-388d-438b-ba55-bdf9feddc3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:10.878256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1194/2398] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:41:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:10.879962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b8d4c-fae4-4274-9d82-b9c28889955d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:10.892386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b8d4c-fae4-4274-9d82-b9c28889955d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:10.895958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266bd96-d881-485d-99d5-fbd695b570d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:10.896605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266bd96-d881-485d-99d5-fbd695b570d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:10.896888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266bd96-d881-485d-99d5-fbd695b570d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:10.897164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266bd96-d881-485d-99d5-fbd695b570d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:10.909102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266bd96-d881-485d-99d5-fbd695b570d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:10.911680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266bd96-d881-485d-99d5-fbd695b570d4 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:10.949661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1205/2399] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:16.279717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbeb27-2318-436a-8bba-5c731f11289d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:16.280302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbeb27-2318-436a-8bba-5c731f11289d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:16.280302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbeb27-2318-436a-8bba-5c731f11289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:16.305099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5dfbeb27-2318-436a-8bba-5c731f11289d None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:16.306509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5dfbeb27-2318-436a-8bba-5c731f11289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:16.314582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1195/2400] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:41:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:16.335130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266bd96-d881-485d-99d5-fbd695b570d4 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:16.352101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266bd96-d881-485d-99d5-fbd695b570d4 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:16.364464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5437c-6789-4dfa-bf30-fea171689ae9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:16.365368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5437c-6789-4dfa-bf30-fea171689ae9 service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:16.369497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5437c-6789-4dfa-bf30-fea171689ae9 service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:16.370027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5437c-6789-4dfa-bf30-fea171689ae9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:16.381094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5437c-6789-4dfa-bf30-fea171689ae9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:16.383669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5437c-6789-4dfa-bf30-fea171689ae9 service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:16.395036 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1206/2401] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:41:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:41:16.522216 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbeb27-2318-436a-8bba-5c731f11289d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:16.535575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbeb27-2318-436a-8bba-5c731f11289d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:16.541214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:16.542393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:16.543140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:16.543625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:16.547589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:16.691745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:16.693233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:16.704789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1196/2402] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:26.657243 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5e72b-3148-4659-a8dc-c976bc46bdd5 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:26.657844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5e72b-3148-4659-a8dc-c976bc46bdd5 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:26.657844 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5e72b-3148-4659-a8dc-c976bc46bdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:26.708431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-baa5e72b-3148-4659-a8dc-c976bc46bdd5 None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:26.709674 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-baa5e72b-3148-4659-a8dc-c976bc46bdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:26.726378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1207/2403] 10.222.0.36 () {58 vars in 967 bytes} [Wed May 11 07:41:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:26.739340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:26.761062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216814e-02d4-4a1a-bebc-56563b3d4c8c service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:26.766163 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31846b3-0973-4d57-97b5-34b43a44f648 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:26.770099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31846b3-0973-4d57-97b5-34b43a44f648 service swift] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:26.770387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31846b3-0973-4d57-97b5-34b43a44f648 service swift] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:26.770664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31846b3-0973-4d57-97b5-34b43a44f648 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:26.782667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31846b3-0973-4d57-97b5-34b43a44f648 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:26.784572 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31846b3-0973-4d57-97b5-34b43a44f648 service swift] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:26.795067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1197/2404] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:41:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:41:28.702063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5e72b-3148-4659-a8dc-c976bc46bdd5 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:28.704025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-baa5e72b-3148-4659-a8dc-c976bc46bdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:28.768831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5e72b-3148-4659-a8dc-c976bc46bdd5 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:28.773259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:28.774153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:28.774431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:28.775218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] PATH_INFO: `/v3/users/2a3cf6ced4ed4d4e87cb9934f020b055` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:28.776392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3cf6ced4ed4d4e87cb9934f020b055)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:28.778330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:28.822306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3cf6ced4ed4d4e87cb9934f020b055'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:28.833387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3cf6ced4ed4d4e87cb9934f020b055'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:28.840437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3cf6ced4ed4d4e87cb9934f020b055'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:28.841129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3cf6ced4ed4d4e87cb9934f020b055'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:28.848166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2b58f9a-d8ec-41f8-9e9f-7f88b9f187d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3cf6ced4ed4d4e87cb9934f020b055'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:28.854647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1208/2405] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:41:28 2022] DELETE /identity/v3/users/2a3cf6ced4ed4d4e87cb9934f020b055 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:29.019219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31846b3-0973-4d57-97b5-34b43a44f648 service swift] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:29.031837 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31846b3-0973-4d57-97b5-34b43a44f648 service swift] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:29.088492 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:29.089450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.089768 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.090045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] PATH_INFO: `/v3/projects/70e0fc25f309475d83688bab2b138157` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.091212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e0fc25f309475d83688bab2b138157)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:29.093105 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:29.139468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e0fc25f309475d83688bab2b138157', 'request_id': 'req-6be27967-c66b-4290-8f11-bf42655522eb'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:29.144701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e0fc25f309475d83688bab2b138157', 'request_id': 'req-6be27967-c66b-4290-8f11-bf42655522eb'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:29.152325 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e0fc25f309475d83688bab2b138157', 'request_id': 'req-6be27967-c66b-4290-8f11-bf42655522eb'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:29.163406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] The token cache is being invalidate because project 70e0fc25f309475d83688bab2b138157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:41:29.163681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:29.164316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6be27967-c66b-4290-8f11-bf42655522eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:29.166404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1198/2406] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:41:29 2022] DELETE /identity/v3/projects/70e0fc25f309475d83688bab2b138157 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:29.171191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53738719-3bed-4237-b3fa-dea1abc87dce None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.171548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53738719-3bed-4237-b3fa-dea1abc87dce None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.171948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53738719-3bed-4237-b3fa-dea1abc87dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.208715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-53738719-3bed-4237-b3fa-dea1abc87dce None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:29.209969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-53738719-3bed-4237-b3fa-dea1abc87dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:29.272452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1209/2407] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:41:29.280887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb615bc-d608-4931-9c6d-54106ff05205 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.281173 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb615bc-d608-4931-9c6d-54106ff05205 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.281445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb615bc-d608-4931-9c6d-54106ff05205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.299857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0bb615bc-d608-4931-9c6d-54106ff05205 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:29.301043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0bb615bc-d608-4931-9c6d-54106ff05205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:29.309365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1199/2408] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:29.313487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53738719-3bed-4237-b3fa-dea1abc87dce None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:29.323288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53738719-3bed-4237-b3fa-dea1abc87dce None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:29.328125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:29.328769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.329050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.329322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.330082 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:41:29.330390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:29.331962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:29.343253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1210/2409] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:41:29.347327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb615bc-d608-4931-9c6d-54106ff05205 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:29.356661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb615bc-d608-4931-9c6d-54106ff05205 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:29.361232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52323ad9-f9ee-4dd1-ba1d-23494e87d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:29.362022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52323ad9-f9ee-4dd1-ba1d-23494e87d8fd admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.362305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52323ad9-f9ee-4dd1-ba1d-23494e87d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.362577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52323ad9-f9ee-4dd1-ba1d-23494e87d8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.363256 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52323ad9-f9ee-4dd1-ba1d-23494e87d8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:29.365133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52323ad9-f9ee-4dd1-ba1d-23494e87d8fd admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:29.389309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1200/2410] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:41:29 2022] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:41:29.393240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:29.402895 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf553a5-6fb9-468c-b285-115c4e75035c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:29.456795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e64d95-5d7a-43e5-87fe-96498b3fbaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:29.457456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e64d95-5d7a-43e5-87fe-96498b3fbaca admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.457770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e64d95-5d7a-43e5-87fe-96498b3fbaca admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.458047 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e64d95-5d7a-43e5-87fe-96498b3fbaca admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.458741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e64d95-5d7a-43e5-87fe-96498b3fbaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:29.460655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e64d95-5d7a-43e5-87fe-96498b3fbaca admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:29.481253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1211/2411] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:41:29 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:41:29.484899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52323ad9-f9ee-4dd1-ba1d-23494e87d8fd admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:29.496358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52323ad9-f9ee-4dd1-ba1d-23494e87d8fd admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:29.501160 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076d98-a8b5-4457-b1ab-f1400a8fc255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:29.501937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076d98-a8b5-4457-b1ab-f1400a8fc255 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.502291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076d98-a8b5-4457-b1ab-f1400a8fc255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.502640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076d98-a8b5-4457-b1ab-f1400a8fc255 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.503466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62076d98-a8b5-4457-b1ab-f1400a8fc255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:29.505140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62076d98-a8b5-4457-b1ab-f1400a8fc255 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:29.518826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1201/2412] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:41:29.520000 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e64d95-5d7a-43e5-87fe-96498b3fbaca admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:29.530460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e64d95-5d7a-43e5-87fe-96498b3fbaca admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:29.534999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abf987-a1ee-47f2-8544-f60bddca058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:29.535663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf987-a1ee-47f2-8544-f60bddca058b admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.535950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf987-a1ee-47f2-8544-f60bddca058b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.536227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf987-a1ee-47f2-8544-f60bddca058b admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.536981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abf987-a1ee-47f2-8544-f60bddca058b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:29.538614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abf987-a1ee-47f2-8544-f60bddca058b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:29.552663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1212/2413] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:41:29.556734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076d98-a8b5-4457-b1ab-f1400a8fc255 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:29.566838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076d98-a8b5-4457-b1ab-f1400a8fc255 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:29.571496 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:29.572438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.572729 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.573003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] PATH_INFO: `/v3/projects/71fc214c46e442c8bebde7188e796224/users/3e0ca12a614a4d1da99a1a890583bcf2/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.590282 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fc214c46e442c8bebde7188e796224, user_id=3e0ca12a614a4d1da99a1a890583bcf2, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:29.593214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:29.608771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1202/2414] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:41:29 2022] PUT /identity/v3/projects/71fc214c46e442c8bebde7188e796224/users/3e0ca12a614a4d1da99a1a890583bcf2/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:29.618621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03100a9e-81ed-46ba-b19a-956f9791e1d1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.618891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03100a9e-81ed-46ba-b19a-956f9791e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.619167 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03100a9e-81ed-46ba-b19a-956f9791e1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.651468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-03100a9e-81ed-46ba-b19a-956f9791e1d1 None None] MFA Rules not processed for user `3e0ca12a614a4d1da99a1a890583bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:29.653263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-03100a9e-81ed-46ba-b19a-956f9791e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:29.724078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1213/2415] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:29.739708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:29.742040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:29.847808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20160-e0e6-40da-8933-870c0a3fbe7a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:29.853736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3bde-1585-4f23-b78a-94a187f71830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:29.854597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3bde-1585-4f23-b78a-94a187f71830 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:29.854952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3bde-1585-4f23-b78a-94a187f71830 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:29.855302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3bde-1585-4f23-b78a-94a187f71830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:29.864686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c3bde-1585-4f23-b78a-94a187f71830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:29.866247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c3bde-1585-4f23-b78a-94a187f71830 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:29.876854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1203/2416] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:30.561429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03100a9e-81ed-46ba-b19a-956f9791e1d1 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:30.562839 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-03100a9e-81ed-46ba-b19a-956f9791e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:30.654333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03100a9e-81ed-46ba-b19a-956f9791e1d1 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:30.659900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e638785-803b-4812-b5e8-f3929a5c5a79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:30.660571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638785-803b-4812-b5e8-f3929a5c5a79 service placement] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:30.660854 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638785-803b-4812-b5e8-f3929a5c5a79 service placement] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:30.661129 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e638785-803b-4812-b5e8-f3929a5c5a79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:30.662949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3e638785-803b-4812-b5e8-f3929a5c5a79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:30.674825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e638785-803b-4812-b5e8-f3929a5c5a79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:30.676396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e638785-803b-4812-b5e8-f3929a5c5a79 service placement] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:30.686689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1214/2417] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:39.531818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3bde-1585-4f23-b78a-94a187f71830 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:39.591052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3bde-1585-4f23-b78a-94a187f71830 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:39.595558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:39.596405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:39.596683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:39.596957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] PATH_INFO: `/v3/users/3e0ca12a614a4d1da99a1a890583bcf2` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:39.598139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0ca12a614a4d1da99a1a890583bcf2)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:39.600867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:39.644344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0ca12a614a4d1da99a1a890583bcf2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:39.656297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0ca12a614a4d1da99a1a890583bcf2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:39.656969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0ca12a614a4d1da99a1a890583bcf2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:39.663545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0ca12a614a4d1da99a1a890583bcf2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:39.664171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0ca12a614a4d1da99a1a890583bcf2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:39.679339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1204/2418] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:41:39 2022] DELETE /identity/v3/users/3e0ca12a614a4d1da99a1a890583bcf2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:39.684317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e76cd-a6be-4154-ad50-cedd7638d9cc None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:39.684780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e76cd-a6be-4154-ad50-cedd7638d9cc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:39.684873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e76cd-a6be-4154-ad50-cedd7638d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:39.702812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-357e76cd-a6be-4154-ad50-cedd7638d9cc None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:39.703998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-357e76cd-a6be-4154-ad50-cedd7638d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:39.767751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1215/2419] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:41:39.777494 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:39.778948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:39.835902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06fc98-f132-41e0-b632-20b128fef400 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:39.839810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05662195-5371-403b-ae2a-0494910cd6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:39.840450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05662195-5371-403b-ae2a-0494910cd6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:39.840733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05662195-5371-403b-ae2a-0494910cd6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:39.841008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05662195-5371-403b-ae2a-0494910cd6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:39.850112 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05662195-5371-403b-ae2a-0494910cd6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:39.851537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05662195-5371-403b-ae2a-0494910cd6c0 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:39.860708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1205/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:40.193264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e76cd-a6be-4154-ad50-cedd7638d9cc None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:40.194738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-357e76cd-a6be-4154-ad50-cedd7638d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:40.206958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e76cd-a6be-4154-ad50-cedd7638d9cc None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:40.211636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:40.213243 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.213523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.213883 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] PATH_INFO: `/v3/projects/71fc214c46e442c8bebde7188e796224` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.214997 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fc214c46e442c8bebde7188e796224)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:40.217169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:40.261864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fc214c46e442c8bebde7188e796224', 'request_id': 'req-54a76101-5584-4b88-a37a-9551b5410d7c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:40.267164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fc214c46e442c8bebde7188e796224', 'request_id': 'req-54a76101-5584-4b88-a37a-9551b5410d7c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:40.274668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fc214c46e442c8bebde7188e796224', 'request_id': 'req-54a76101-5584-4b88-a37a-9551b5410d7c'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:40.285180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] The token cache is being invalidate because project 71fc214c46e442c8bebde7188e796224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:41:40.285462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:40.286094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-54a76101-5584-4b88-a37a-9551b5410d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:40.287589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1216/2421] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:41:40 2022] DELETE /identity/v3/projects/71fc214c46e442c8bebde7188e796224 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:40.292865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc00f59-c0d8-454f-a03b-55e07554494f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.293153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc00f59-c0d8-454f-a03b-55e07554494f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.293428 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc00f59-c0d8-454f-a03b-55e07554494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.310770 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-6bc00f59-c0d8-454f-a03b-55e07554494f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:40.311944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-6bc00f59-c0d8-454f-a03b-55e07554494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:40.368317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1206/2422] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:40.377587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab8ee-2f97-4a79-82bc-0e35015e9dea None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.377880 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab8ee-2f97-4a79-82bc-0e35015e9dea None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.378161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ab8ee-2f97-4a79-82bc-0e35015e9dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.396430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-783ab8ee-2f97-4a79-82bc-0e35015e9dea None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:40.397638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-783ab8ee-2f97-4a79-82bc-0e35015e9dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:40.405206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1217/2423] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:40.409109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc00f59-c0d8-454f-a03b-55e07554494f None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:40.418857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc00f59-c0d8-454f-a03b-55e07554494f None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:40.423553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:40.424207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.424491 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.424799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.425522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:41:40.425868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:40.427468 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:40.439212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1207/2424] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:41:40.443642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab8ee-2f97-4a79-82bc-0e35015e9dea None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:40.452411 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ab8ee-2f97-4a79-82bc-0e35015e9dea None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:40.456915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4701a-1c79-461f-addb-010b804b9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:40.457589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4701a-1c79-461f-addb-010b804b9a3c admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.457871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4701a-1c79-461f-addb-010b804b9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.458139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4701a-1c79-461f-addb-010b804b9a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.458827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4701a-1c79-461f-addb-010b804b9a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:40.460694 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4701a-1c79-461f-addb-010b804b9a3c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:40.486172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1218/2425] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:41:40 2022] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:41:40.490091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:40.499782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74259-6fb2-4d03-b741-d85a9c64b370 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:40.555176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123797-dd86-4c8e-b43b-736f2d000c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:40.555832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123797-dd86-4c8e-b43b-736f2d000c06 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.556114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123797-dd86-4c8e-b43b-736f2d000c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.556389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2123797-dd86-4c8e-b43b-736f2d000c06 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.557062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2123797-dd86-4c8e-b43b-736f2d000c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:40.558990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2123797-dd86-4c8e-b43b-736f2d000c06 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:40.580545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1208/2426] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:41:40 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:41:40.581906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4701a-1c79-461f-addb-010b804b9a3c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:40.592279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4701a-1c79-461f-addb-010b804b9a3c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:40.596713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f80b-f88c-42c4-96b2-ffdc9d9e53c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:40.597354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f80b-f88c-42c4-96b2-ffdc9d9e53c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.597666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f80b-f88c-42c4-96b2-ffdc9d9e53c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.597940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105f80b-f88c-42c4-96b2-ffdc9d9e53c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.598651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105f80b-f88c-42c4-96b2-ffdc9d9e53c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:40.600226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105f80b-f88c-42c4-96b2-ffdc9d9e53c6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:40.610690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1219/2427] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:41:40.614356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123797-dd86-4c8e-b43b-736f2d000c06 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:40.624075 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2123797-dd86-4c8e-b43b-736f2d000c06 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:40.628979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424017d-ded5-4eb2-958e-e5906f8de1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:40.629671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424017d-ded5-4eb2-958e-e5906f8de1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.629957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424017d-ded5-4eb2-958e-e5906f8de1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.630236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424017d-ded5-4eb2-958e-e5906f8de1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.630955 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424017d-ded5-4eb2-958e-e5906f8de1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:40.632537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424017d-ded5-4eb2-958e-e5906f8de1c7 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:40.642835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1209/2428] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:41:40.646787 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f80b-f88c-42c4-96b2-ffdc9d9e53c6 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:40.657145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105f80b-f88c-42c4-96b2-ffdc9d9e53c6 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:40.661682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:40.662552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.662831 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.663102 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] PATH_INFO: `/v3/projects/ea2864ee8cbb4e158e3c11f30f2229e8/users/880edd6a287a451f9d5e66472075f89c/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.677612 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2864ee8cbb4e158e3c11f30f2229e8, user_id=880edd6a287a451f9d5e66472075f89c, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:40.680245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:40.692785 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1220/2429] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:41:40 2022] PUT /identity/v3/projects/ea2864ee8cbb4e158e3c11f30f2229e8/users/880edd6a287a451f9d5e66472075f89c/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:40.702881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54b44-6478-46f1-a0d2-2035d494ab3e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.703174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54b44-6478-46f1-a0d2-2035d494ab3e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.703482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54b44-6478-46f1-a0d2-2035d494ab3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.730989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4fb54b44-6478-46f1-a0d2-2035d494ab3e None None] MFA Rules not processed for user `880edd6a287a451f9d5e66472075f89c`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:40.732190 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4fb54b44-6478-46f1-a0d2-2035d494ab3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:40.792271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1210/2430] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:40.803441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:40.805104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:40.859732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3b538-1ac3-417a-8122-bb765e3fea29 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:40.863329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:40.863969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:40.864253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:40.864524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:40.872632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:40.874184 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:40.883090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1221/2431] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:41.232444 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d93e-b56b-450c-aea0-bb41eb1780fe None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:41.232834 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d93e-b56b-450c-aea0-bb41eb1780fe None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:41.233189 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783d93e-b56b-450c-aea0-bb41eb1780fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:41.263759 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8783d93e-b56b-450c-aea0-bb41eb1780fe None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:41.264970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8783d93e-b56b-450c-aea0-bb41eb1780fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:41.330511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1211/2432] 10.222.0.36 () {58 vars in 967 bytes} [Wed May 11 07:41:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:41.343614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:41.345037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:41.425772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfaa7fe-7040-457d-8646-30817a9f751f service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:41.431659 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16244-3e55-473f-9189-903e95c430b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:41.432300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16244-3e55-473f-9189-903e95c430b7 service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:41.432582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16244-3e55-473f-9189-903e95c430b7 service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:41.432853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16244-3e55-473f-9189-903e95c430b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:41.440776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad16244-3e55-473f-9189-903e95c430b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:41.442653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad16244-3e55-473f-9189-903e95c430b7 service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:41.451174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1222/2433] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:41:48.921464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d93e-b56b-450c-aea0-bb41eb1780fe None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:48.981947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783d93e-b56b-450c-aea0-bb41eb1780fe None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:48.986327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:48.987177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:48.987457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:48.987757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] PATH_INFO: `/v3/users/880edd6a287a451f9d5e66472075f89c` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:48.988915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=880edd6a287a451f9d5e66472075f89c)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:48.990851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:49.035453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880edd6a287a451f9d5e66472075f89c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.046645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880edd6a287a451f9d5e66472075f89c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.047306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880edd6a287a451f9d5e66472075f89c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.053848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880edd6a287a451f9d5e66472075f89c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.054474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880edd6a287a451f9d5e66472075f89c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.067606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1212/2434] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:41:48 2022] DELETE /identity/v3/users/880edd6a287a451f9d5e66472075f89c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:49.072179 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ce5f-0ff5-46a3-939c-3543346d7487 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.072645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ce5f-0ff5-46a3-939c-3543346d7487 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.072738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960ce5f-0ff5-46a3-939c-3543346d7487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.090493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f960ce5f-0ff5-46a3-939c-3543346d7487 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:49.091658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f960ce5f-0ff5-46a3-939c-3543346d7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:49.147467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1223/2435] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:49.157611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:49.159011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:49.215241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc47d30-9358-4dcc-b921-e1fa9c5db056 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:49.219081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98651ca3-8fc9-4809-8bfc-d219dd4e2179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:49.219723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651ca3-8fc9-4809-8bfc-d219dd4e2179 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.220108 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651ca3-8fc9-4809-8bfc-d219dd4e2179 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.220521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651ca3-8fc9-4809-8bfc-d219dd4e2179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.229699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98651ca3-8fc9-4809-8bfc-d219dd4e2179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:49.231106 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98651ca3-8fc9-4809-8bfc-d219dd4e2179 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:49.240426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1213/2436] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:49.568036 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960ce5f-0ff5-46a3-939c-3543346d7487 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:49.569567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f960ce5f-0ff5-46a3-939c-3543346d7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:49.583281 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960ce5f-0ff5-46a3-939c-3543346d7487 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:49.587922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:49.588864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.589151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.589609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] PATH_INFO: `/v3/projects/ea2864ee8cbb4e158e3c11f30f2229e8` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.590807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2864ee8cbb4e158e3c11f30f2229e8)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:49.592758 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:49.640607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2864ee8cbb4e158e3c11f30f2229e8', 'request_id': 'req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.645970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2864ee8cbb4e158e3c11f30f2229e8', 'request_id': 'req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.653095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2864ee8cbb4e158e3c11f30f2229e8', 'request_id': 'req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.663857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] The token cache is being invalidate because project ea2864ee8cbb4e158e3c11f30f2229e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:41:49.664153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.665131 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fec4a82a-1818-4bc8-9c6d-6a83d1f19054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:41:49.666712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1224/2437] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:41:49 2022] DELETE /identity/v3/projects/ea2864ee8cbb4e158e3c11f30f2229e8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:49.672220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fda4e-0689-488a-9de9-fbcbfba5daea None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.672509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fda4e-0689-488a-9de9-fbcbfba5daea None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.672787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fda4e-0689-488a-9de9-fbcbfba5daea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.690264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d49fda4e-0689-488a-9de9-fbcbfba5daea None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:49.691647 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d49fda4e-0689-488a-9de9-fbcbfba5daea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:49.750305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1214/2438] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:49.757614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e451-a3e9-4755-8157-41866ed82997 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.757912 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e451-a3e9-4755-8157-41866ed82997 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.758192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877e451-a3e9-4755-8157-41866ed82997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.775832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-7877e451-a3e9-4755-8157-41866ed82997 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:49.777030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7877e451-a3e9-4755-8157-41866ed82997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:49.784842 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1225/2439] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:49.788719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fda4e-0689-488a-9de9-fbcbfba5daea None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:49.799681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fda4e-0689-488a-9de9-fbcbfba5daea None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:49.804226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:49.804872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.805156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.805431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.806198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:41:49.806509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:49.808721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:49.820038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1215/2440] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:41:49.824033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877e451-a3e9-4755-8157-41866ed82997 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:49.833249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877e451-a3e9-4755-8157-41866ed82997 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:49.837926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158783-b7b4-405e-878e-9ff7f041e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:49.838583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158783-b7b4-405e-878e-9ff7f041e7fa admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.838867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158783-b7b4-405e-878e-9ff7f041e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.839144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18158783-b7b4-405e-878e-9ff7f041e7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.839991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18158783-b7b4-405e-878e-9ff7f041e7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:49.841973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18158783-b7b4-405e-878e-9ff7f041e7fa admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:49.867123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1226/2441] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:41:49 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:41:49.871931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:49.881568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7980a3-7cce-4746-84a8-05f77fbaec38 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:49.934774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6b2c3-abd9-4311-9aea-3ddcd4f0f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:49.935432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b2c3-abd9-4311-9aea-3ddcd4f0f367 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.935847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b2c3-abd9-4311-9aea-3ddcd4f0f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.936212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6b2c3-abd9-4311-9aea-3ddcd4f0f367 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.936919 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6b2c3-abd9-4311-9aea-3ddcd4f0f367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:49.938891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6b2c3-abd9-4311-9aea-3ddcd4f0f367 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:49.961400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1216/2442] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:41:49 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:41:49.962591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158783-b7b4-405e-878e-9ff7f041e7fa admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:49.972669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18158783-b7b4-405e-878e-9ff7f041e7fa admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:49.977174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37b7f5-7e9d-4ade-a61e-e3f8cefac5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:49.977849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37b7f5-7e9d-4ade-a61e-e3f8cefac5cb admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:49.978126 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37b7f5-7e9d-4ade-a61e-e3f8cefac5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:49.978396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37b7f5-7e9d-4ade-a61e-e3f8cefac5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:49.979114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37b7f5-7e9d-4ade-a61e-e3f8cefac5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:49.981253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37b7f5-7e9d-4ade-a61e-e3f8cefac5cb admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:49.991246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1227/2443] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:41:49.994992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6b2c3-abd9-4311-9aea-3ddcd4f0f367 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:50.005283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6b2c3-abd9-4311-9aea-3ddcd4f0f367 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:50.009851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4fc38-b647-4c2f-addb-e8431c3284b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:50.010496 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4fc38-b647-4c2f-addb-e8431c3284b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:50.010779 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4fc38-b647-4c2f-addb-e8431c3284b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:50.011073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4fc38-b647-4c2f-addb-e8431c3284b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:50.011794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4fc38-b647-4c2f-addb-e8431c3284b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:50.013374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4fc38-b647-4c2f-addb-e8431c3284b1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:50.022908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1217/2444] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:41:50.026698 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37b7f5-7e9d-4ade-a61e-e3f8cefac5cb admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:50.036158 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37b7f5-7e9d-4ade-a61e-e3f8cefac5cb admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:50.040634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:50.041483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:50.041798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:50.042070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] PATH_INFO: `/v3/projects/03e1fa8f24714fc9af8b0947ec51aede/users/bdcfff1647ac4569b96ad948bf991c60/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:50.056460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e1fa8f24714fc9af8b0947ec51aede, user_id=bdcfff1647ac4569b96ad948bf991c60, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:50.059772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:50.071813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1228/2445] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:41:50 2022] PUT /identity/v3/projects/03e1fa8f24714fc9af8b0947ec51aede/users/bdcfff1647ac4569b96ad948bf991c60/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:50.076818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109592db-62c7-4522-a4a3-35f611f231aa None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:50.077172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109592db-62c7-4522-a4a3-35f611f231aa None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:50.077553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109592db-62c7-4522-a4a3-35f611f231aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:50.094705 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-109592db-62c7-4522-a4a3-35f611f231aa None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:50.095870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-109592db-62c7-4522-a4a3-35f611f231aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:50.152508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1218/2446] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:50.162078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:50.163762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:50.219264 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecb6c0-5e6f-495b-86a8-a7d96d879f4d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:50.222751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530597-205d-406b-ab07-55be80b29145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:50.223380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530597-205d-406b-ab07-55be80b29145 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:50.223660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530597-205d-406b-ab07-55be80b29145 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:50.223928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530597-205d-406b-ab07-55be80b29145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:50.233064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530597-205d-406b-ab07-55be80b29145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:50.234508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530597-205d-406b-ab07-55be80b29145 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:50.243459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1229/2447] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:41:54.444510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5426b8-bd44-4fec-86e2-fdf1366415c8 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:54.445091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5426b8-bd44-4fec-86e2-fdf1366415c8 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:54.445091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5426b8-bd44-4fec-86e2-fdf1366415c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:54.473951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4d5426b8-bd44-4fec-86e2-fdf1366415c8 None None] MFA Rules not processed for user `bdcfff1647ac4569b96ad948bf991c60`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:54.475251 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4d5426b8-bd44-4fec-86e2-fdf1366415c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:54.541674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1219/2448] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:41:54.546272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530597-205d-406b-ab07-55be80b29145 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:54.556046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530597-205d-406b-ab07-55be80b29145 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:54.560879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5476-ca79-4a5b-a5d4-a9ebea467b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:54.561723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5476-ca79-4a5b-a5d4-a9ebea467b8c admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:54.562022 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5476-ca79-4a5b-a5d4-a9ebea467b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:54.562361 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5476-ca79-4a5b-a5d4-a9ebea467b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:54.563048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5476-ca79-4a5b-a5d4-a9ebea467b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:54.564946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5476-ca79-4a5b-a5d4-a9ebea467b8c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:54.592186 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1230/2449] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:41:54 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:41:54.596202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5426b8-bd44-4fec-86e2-fdf1366415c8 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:54.607370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5426b8-bd44-4fec-86e2-fdf1366415c8 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:54.669287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e86a6a-db09-4a58-a89c-69287a1c6f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:54.670006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86a6a-db09-4a58-a89c-69287a1c6f69 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:54.670284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86a6a-db09-4a58-a89c-69287a1c6f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:54.670581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e86a6a-db09-4a58-a89c-69287a1c6f69 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:54.671254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e86a6a-db09-4a58-a89c-69287a1c6f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:54.673177 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e86a6a-db09-4a58-a89c-69287a1c6f69 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:54.692547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1220/2450] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:41:54 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:41:54.696316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5476-ca79-4a5b-a5d4-a9ebea467b8c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:54.706232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5476-ca79-4a5b-a5d4-a9ebea467b8c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:54.710723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bee414-c8c8-4ba5-ac9d-f5ad99916c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:54.711364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bee414-c8c8-4ba5-ac9d-f5ad99916c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:54.711646 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bee414-c8c8-4ba5-ac9d-f5ad99916c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:54.711917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bee414-c8c8-4ba5-ac9d-f5ad99916c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:54.712628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bee414-c8c8-4ba5-ac9d-f5ad99916c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:54.714779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bee414-c8c8-4ba5-ac9d-f5ad99916c29 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:54.724724 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1231/2451] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:41:54.728641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e86a6a-db09-4a58-a89c-69287a1c6f69 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:54.739069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e86a6a-db09-4a58-a89c-69287a1c6f69 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:54.743782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71fde-508c-4f03-ba05-55c378395110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:54.744651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71fde-508c-4f03-ba05-55c378395110 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:54.744936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71fde-508c-4f03-ba05-55c378395110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:54.745219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d71fde-508c-4f03-ba05-55c378395110 admin admin] PATH_INFO: `/v3/projects/2aba240f079841fdb01071e98259eec1/users/86c9d97749934b15906f403b7e17127f/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:54.759577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d71fde-508c-4f03-ba05-55c378395110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aba240f079841fdb01071e98259eec1, user_id=86c9d97749934b15906f403b7e17127f, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:54.762291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d71fde-508c-4f03-ba05-55c378395110 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:54.774263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1221/2452] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:41:54 2022] PUT /identity/v3/projects/2aba240f079841fdb01071e98259eec1/users/86c9d97749934b15906f403b7e17127f/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:54.778625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bee414-c8c8-4ba5-ac9d-f5ad99916c29 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:54.788165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bee414-c8c8-4ba5-ac9d-f5ad99916c29 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:54.842586 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b02891-51cf-46b1-b275-0b238f66fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:54.843398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02891-51cf-46b1-b275-0b238f66fe67 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:54.843676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02891-51cf-46b1-b275-0b238f66fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:54.843953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02891-51cf-46b1-b275-0b238f66fe67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:54.844763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b02891-51cf-46b1-b275-0b238f66fe67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:54.846640 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b02891-51cf-46b1-b275-0b238f66fe67 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:54.860168 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1232/2453] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:41:54.861394 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71fde-508c-4f03-ba05-55c378395110 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:41:54.872003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d71fde-508c-4f03-ba05-55c378395110 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:41:54.876944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c68c22-f867-4bbf-9a62-198751fef72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:41:54.877805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68c22-f867-4bbf-9a62-198751fef72b admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:54.878090 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68c22-f867-4bbf-9a62-198751fef72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:54.878364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68c22-f867-4bbf-9a62-198751fef72b admin admin] PATH_INFO: `/v3/projects/2aba240f079841fdb01071e98259eec1/users/86c9d97749934b15906f403b7e17127f/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:54.880422 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c68c22-f867-4bbf-9a62-198751fef72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aba240f079841fdb01071e98259eec1, user_id=86c9d97749934b15906f403b7e17127f, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:41:54.883181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c68c22-f867-4bbf-9a62-198751fef72b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:41:54.894300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1222/2454] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:41:54 2022] PUT /identity/v3/projects/2aba240f079841fdb01071e98259eec1/users/86c9d97749934b15906f403b7e17127f/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:41:58.126558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb7b59-4567-4906-845a-b3c446318358 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:41:58.127811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb7b59-4567-4906-845a-b3c446318358 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:41:58.128257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb7b59-4567-4906-845a-b3c446318358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:41:58.164594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-70fb7b59-4567-4906-845a-b3c446318358 None None] MFA Rules not processed for user `cb70f7eb7b44487a9ee3f331c83f9e31`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:41:58.166150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-70fb7b59-4567-4906-845a-b3c446318358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:41:58.276992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1233/2455] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:41:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:42:00.082339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a537ef-b52b-440a-8876-4b5f4794cc66 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:00.083151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a537ef-b52b-440a-8876-4b5f4794cc66 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:00.083649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a537ef-b52b-440a-8876-4b5f4794cc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:00.130461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d0a537ef-b52b-440a-8876-4b5f4794cc66 None None] MFA Rules not processed for user `86c9d97749934b15906f403b7e17127f`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:42:00.131750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d0a537ef-b52b-440a-8876-4b5f4794cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:42:00.243978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1223/2456] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:42:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:42:00.256993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb7b59-4567-4906-845a-b3c446318358 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:42:00.258561 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-70fb7b59-4567-4906-845a-b3c446318358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:42:00.359565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb7b59-4567-4906-845a-b3c446318358 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:42:00.371932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91feeca74fe749fba52423aa28d48916', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:42:00.372684 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:00.372973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:00.373256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:00.447343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:42:00.449835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:42:00.469003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1234/2457] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:42:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:42:00.634598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c24ba-786a-4345-847f-85497c8dae48 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:00.634894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c24ba-786a-4345-847f-85497c8dae48 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:00.635176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c24ba-786a-4345-847f-85497c8dae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:00.656271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-547c24ba-786a-4345-847f-85497c8dae48 None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:42:00.657854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-547c24ba-786a-4345-847f-85497c8dae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:42:00.731365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1224/2458] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:42:00.752318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:42:00.753946 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:42:00.821874 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f6363-c9e9-4d54-8cf4-c4061c50c8af service glance] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:42:00.827462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919d7eb-9354-4510-bbe1-3f2ddd1e674a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:42:00.828115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919d7eb-9354-4510-bbe1-3f2ddd1e674a service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:00.828400 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919d7eb-9354-4510-bbe1-3f2ddd1e674a service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:00.828680 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919d7eb-9354-4510-bbe1-3f2ddd1e674a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:00.836884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919d7eb-9354-4510-bbe1-3f2ddd1e674a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:42:00.838532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919d7eb-9354-4510-bbe1-3f2ddd1e674a service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:42:00.846743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1235/2459] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:42:10.197469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d2db8-818b-48a8-9fde-3f5d89aeb3a3 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:10.198051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d2db8-818b-48a8-9fde-3f5d89aeb3a3 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:10.198051 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d2db8-818b-48a8-9fde-3f5d89aeb3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:10.214917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7a4d2db8-818b-48a8-9fde-3f5d89aeb3a3 None None] MFA Rules not processed for user `bdcfff1647ac4569b96ad948bf991c60`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:42:10.216113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7a4d2db8-818b-48a8-9fde-3f5d89aeb3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:42:10.223224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1225/2460] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:42:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:42:11.969922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02022e90-f80e-4499-a6e0-13f96a02d8e1 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:11.969922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02022e90-f80e-4499-a6e0-13f96a02d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:11.970502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02022e90-f80e-4499-a6e0-13f96a02d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:11.989249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-02022e90-f80e-4499-a6e0-13f96a02d8e1 None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:42:11.999222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-02022e90-f80e-4499-a6e0-13f96a02d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:42:12.007193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1236/2461] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:42:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:42:12.019063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d2db8-818b-48a8-9fde-3f5d89aeb3a3 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:42:12.031215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d2db8-818b-48a8-9fde-3f5d89aeb3a3 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:42:12.036258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:42:12.036908 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:12.037194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:12.037473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:12.046338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:42:12.047933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:42:12.055906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1226/2462] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:42:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:42:33.329839 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d128a5-48a1-4fa7-9b52-51cd501e6ce0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:33.330358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d128a5-48a1-4fa7-9b52-51cd501e6ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:33.330454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d128a5-48a1-4fa7-9b52-51cd501e6ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:33.348639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d9d128a5-48a1-4fa7-9b52-51cd501e6ce0 None None] MFA Rules not processed for user `c6bb9dabb1fc46dda1fe1906ab248c57`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:42:33.349962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d9d128a5-48a1-4fa7-9b52-51cd501e6ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:42:33.401949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1237/2463] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:42:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:42:42.792198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:42:42.793674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:42:42.852292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bca21b-29d7-4a1e-a521-931a072c351f service swift] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:42:42.856115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd64179-3a88-43d6-af0e-03be8da08abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:42:42.856763 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64179-3a88-43d6-af0e-03be8da08abc service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:42:42.857053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64179-3a88-43d6-af0e-03be8da08abc service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:42:42.857559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64179-3a88-43d6-af0e-03be8da08abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:42:42.867165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd64179-3a88-43d6-af0e-03be8da08abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:42:42.868651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd64179-3a88-43d6-af0e-03be8da08abc service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:42:42.878238 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1227/2464] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:42:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:05.557093 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d128a5-48a1-4fa7-9b52-51cd501e6ce0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:05.558673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d9d128a5-48a1-4fa7-9b52-51cd501e6ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:05.624866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d128a5-48a1-4fa7-9b52-51cd501e6ce0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:05.629319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:05.630240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:05.630519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:05.630792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] PATH_INFO: `/v3/users/cb70f7eb7b44487a9ee3f331c83f9e31` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:05.631971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb70f7eb7b44487a9ee3f331c83f9e31)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:05.633964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:05.680519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb70f7eb7b44487a9ee3f331c83f9e31'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:05.692473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb70f7eb7b44487a9ee3f331c83f9e31'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:05.699108 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb70f7eb7b44487a9ee3f331c83f9e31'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:05.699868 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb70f7eb7b44487a9ee3f331c83f9e31'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:05.708305 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-f976c860-136f-4bd4-8c60-c6da493d0333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb70f7eb7b44487a9ee3f331c83f9e31'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:05.714732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1238/2465] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:05 2022] DELETE /identity/v3/users/cb70f7eb7b44487a9ee3f331c83f9e31 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:05.888676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd64179-3a88-43d6-af0e-03be8da08abc service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:05.899391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd64179-3a88-43d6-af0e-03be8da08abc service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:05.957410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:05.958226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:05.958512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:05.958948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] PATH_INFO: `/v3/projects/5100c1cfe7f148058734c0da2d1497d4` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:05.960657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5100c1cfe7f148058734c0da2d1497d4)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:05.962610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.009758 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5100c1cfe7f148058734c0da2d1497d4', 'request_id': 'req-aedf79aa-06d5-4683-94cd-0927454c8e71'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:06.016057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5100c1cfe7f148058734c0da2d1497d4', 'request_id': 'req-aedf79aa-06d5-4683-94cd-0927454c8e71'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:06.023322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5100c1cfe7f148058734c0da2d1497d4', 'request_id': 'req-aedf79aa-06d5-4683-94cd-0927454c8e71'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:06.034065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] The token cache is being invalidate because project 5100c1cfe7f148058734c0da2d1497d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:06.034350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:06.034987 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-aedf79aa-06d5-4683-94cd-0927454c8e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:06.036638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1228/2466] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:05 2022] DELETE /identity/v3/projects/5100c1cfe7f148058734c0da2d1497d4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:06.041519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab914-3742-4022-8a0f-b840c5d67f21 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.041846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab914-3742-4022-8a0f-b840c5d67f21 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.042164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab914-3742-4022-8a0f-b840c5d67f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.060427 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b1dab914-3742-4022-8a0f-b840c5d67f21 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:06.061660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b1dab914-3742-4022-8a0f-b840c5d67f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:06.117347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1239/2467] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:06.125851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a7869-060f-4b2b-85a0-941ae4d8060a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.126226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a7869-060f-4b2b-85a0-941ae4d8060a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.126569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a7869-060f-4b2b-85a0-941ae4d8060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.144174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-838a7869-060f-4b2b-85a0-941ae4d8060a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:06.145439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-838a7869-060f-4b2b-85a0-941ae4d8060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:06.153096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1229/2468] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:43:06.156974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dab914-3742-4022-8a0f-b840c5d67f21 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.166160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dab914-3742-4022-8a0f-b840c5d67f21 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.171159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.171797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.172076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.172350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.173068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:43:06.173370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.174979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.186591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1240/2469] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:43:06.190716 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a7869-060f-4b2b-85a0-941ae4d8060a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.199825 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a7869-060f-4b2b-85a0-941ae4d8060a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.204439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b248a53-e35d-454d-9e32-62b715b9978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.205077 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248a53-e35d-454d-9e32-62b715b9978d admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.205362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248a53-e35d-454d-9e32-62b715b9978d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.205666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248a53-e35d-454d-9e32-62b715b9978d admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.206348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b248a53-e35d-454d-9e32-62b715b9978d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.208290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b248a53-e35d-454d-9e32-62b715b9978d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.232378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1230/2470] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:06 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:06.236747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.249162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eadd7d-d279-4808-a39b-0e7ce4ee0948 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.301852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825121d-7ed6-4c00-bd86-7bd20c1940ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.302504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825121d-7ed6-4c00-bd86-7bd20c1940ce admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.302784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825121d-7ed6-4c00-bd86-7bd20c1940ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.303070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825121d-7ed6-4c00-bd86-7bd20c1940ce admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.303721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825121d-7ed6-4c00-bd86-7bd20c1940ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.305650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825121d-7ed6-4c00-bd86-7bd20c1940ce admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.324583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1241/2471] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:06 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:06.329236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b248a53-e35d-454d-9e32-62b715b9978d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.339209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b248a53-e35d-454d-9e32-62b715b9978d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.346562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc4275-033d-4bb6-a953-785d0504fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.347373 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc4275-033d-4bb6-a953-785d0504fc86 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.347853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc4275-033d-4bb6-a953-785d0504fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.348347 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc4275-033d-4bb6-a953-785d0504fc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.349475 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc4275-033d-4bb6-a953-785d0504fc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.351109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc4275-033d-4bb6-a953-785d0504fc86 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.362608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1231/2472] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:06.366560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825121d-7ed6-4c00-bd86-7bd20c1940ce admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.376119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825121d-7ed6-4c00-bd86-7bd20c1940ce admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.380583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba73be7-321a-4056-b61f-8f21f3b7f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.381220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73be7-321a-4056-b61f-8f21f3b7f53b admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.381500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73be7-321a-4056-b61f-8f21f3b7f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.381808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba73be7-321a-4056-b61f-8f21f3b7f53b admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.382523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba73be7-321a-4056-b61f-8f21f3b7f53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.384096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba73be7-321a-4056-b61f-8f21f3b7f53b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.394063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1242/2473] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:06.398382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc4275-033d-4bb6-a953-785d0504fc86 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.408766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc4275-033d-4bb6-a953-785d0504fc86 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.415309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c669-eb09-4fa5-ad63-c5a66615a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.416184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c669-eb09-4fa5-ad63-c5a66615a9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.416471 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c669-eb09-4fa5-ad63-c5a66615a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.416752 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c669-eb09-4fa5-ad63-c5a66615a9bb admin admin] PATH_INFO: `/v3/projects/3a5b14bd451f4cf78fa9067887caff07/users/ef1ff1842c6c42a28783c65a508829bc/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.430697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274c669-eb09-4fa5-ad63-c5a66615a9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5b14bd451f4cf78fa9067887caff07, user_id=ef1ff1842c6c42a28783c65a508829bc, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.433356 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274c669-eb09-4fa5-ad63-c5a66615a9bb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.446604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1232/2474] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:06 2022] PUT /identity/v3/projects/3a5b14bd451f4cf78fa9067887caff07/users/ef1ff1842c6c42a28783c65a508829bc/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:06.457027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0011db3-64df-440e-9f49-2ee16bda4c1c None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.457348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0011db3-64df-440e-9f49-2ee16bda4c1c None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.457656 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0011db3-64df-440e-9f49-2ee16bda4c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.484928 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e0011db3-64df-440e-9f49-2ee16bda4c1c None None] MFA Rules not processed for user `ef1ff1842c6c42a28783c65a508829bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:06.486066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e0011db3-64df-440e-9f49-2ee16bda4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:06.547312 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1243/2475] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:06.551732 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c669-eb09-4fa5-ad63-c5a66615a9bb admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.612191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c669-eb09-4fa5-ad63-c5a66615a9bb admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.616884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1f1c5-5264-4c0c-ab69-b6aa1a09f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.617578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1f1c5-5264-4c0c-ab69-b6aa1a09f38c admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.617871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1f1c5-5264-4c0c-ab69-b6aa1a09f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.618157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1f1c5-5264-4c0c-ab69-b6aa1a09f38c admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.618848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1f1c5-5264-4c0c-ab69-b6aa1a09f38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.620772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1f1c5-5264-4c0c-ab69-b6aa1a09f38c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.647433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1233/2476] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:06 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:06.651604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0011db3-64df-440e-9f49-2ee16bda4c1c None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.661969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0011db3-64df-440e-9f49-2ee16bda4c1c None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.716350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e12c19-ae71-4a61-9353-f4403b6e6162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.717015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e12c19-ae71-4a61-9353-f4403b6e6162 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.717295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e12c19-ae71-4a61-9353-f4403b6e6162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.717598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e12c19-ae71-4a61-9353-f4403b6e6162 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.718276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e12c19-ae71-4a61-9353-f4403b6e6162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.720178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e12c19-ae71-4a61-9353-f4403b6e6162 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.743292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1244/2477] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:06 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:06.744769 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1f1c5-5264-4c0c-ab69-b6aa1a09f38c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.755493 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1f1c5-5264-4c0c-ab69-b6aa1a09f38c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.760263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ac6f-c8fa-4d92-92fb-fd1285d52591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.760923 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ac6f-c8fa-4d92-92fb-fd1285d52591 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.761213 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ac6f-c8fa-4d92-92fb-fd1285d52591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.761500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0ac6f-c8fa-4d92-92fb-fd1285d52591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.762287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0ac6f-c8fa-4d92-92fb-fd1285d52591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.764431 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0ac6f-c8fa-4d92-92fb-fd1285d52591 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.778024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1234/2478] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:06.778978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e12c19-ae71-4a61-9353-f4403b6e6162 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.788802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e12c19-ae71-4a61-9353-f4403b6e6162 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.793766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299101-deac-4095-a239-e7ac74756c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.794655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299101-deac-4095-a239-e7ac74756c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.794942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299101-deac-4095-a239-e7ac74756c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.795249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299101-deac-4095-a239-e7ac74756c11 admin admin] PATH_INFO: `/v3/projects/7d0614f4003e42c1ab60cf9504d8dd54/users/f88d99122c2342aaa7db2356cc5c7ce7/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.809835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299101-deac-4095-a239-e7ac74756c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0614f4003e42c1ab60cf9504d8dd54, user_id=f88d99122c2342aaa7db2356cc5c7ce7, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.813009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299101-deac-4095-a239-e7ac74756c11 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.826454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1245/2479] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:06 2022] PUT /identity/v3/projects/7d0614f4003e42c1ab60cf9504d8dd54/users/f88d99122c2342aaa7db2356cc5c7ce7/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:43:06.830511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ac6f-c8fa-4d92-92fb-fd1285d52591 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.840609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0ac6f-c8fa-4d92-92fb-fd1285d52591 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.899006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4e063-6cd1-47d6-92b7-8cab5ecb20c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.900357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4e063-6cd1-47d6-92b7-8cab5ecb20c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.900789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4e063-6cd1-47d6-92b7-8cab5ecb20c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.901285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4e063-6cd1-47d6-92b7-8cab5ecb20c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.902359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4e063-6cd1-47d6-92b7-8cab5ecb20c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.904293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4e063-6cd1-47d6-92b7-8cab5ecb20c3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.915071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1235/2480] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:06.919754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299101-deac-4095-a239-e7ac74756c11 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:06.930237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299101-deac-4095-a239-e7ac74756c11 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:06.935597 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:06.936560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.936973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.937265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] PATH_INFO: `/v3/projects/7d0614f4003e42c1ab60cf9504d8dd54/users/f88d99122c2342aaa7db2356cc5c7ce7/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.939266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0614f4003e42c1ab60cf9504d8dd54, user_id=f88d99122c2342aaa7db2356cc5c7ce7, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:06.942272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:06.961894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1246/2481] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:06 2022] PUT /identity/v3/projects/7d0614f4003e42c1ab60cf9504d8dd54/users/f88d99122c2342aaa7db2356cc5c7ce7/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:06.963658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aba95-cb48-44d5-b9b4-4f90d2f3bb7b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:06.963951 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aba95-cb48-44d5-b9b4-4f90d2f3bb7b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:06.964227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aba95-cb48-44d5-b9b4-4f90d2f3bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:06.991780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-597aba95-cb48-44d5-b9b4-4f90d2f3bb7b None None] MFA Rules not processed for user `f88d99122c2342aaa7db2356cc5c7ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:06.993145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-597aba95-cb48-44d5-b9b4-4f90d2f3bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:07.066554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1236/2482] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:07.078403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:07.080249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:07.139034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64beda3-49a2-410f-a1f0-ce9a679589bc admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:07.143950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478930a-99da-4f69-8d15-fefeaf6c7343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:07.144718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478930a-99da-4f69-8d15-fefeaf6c7343 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:07.144835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478930a-99da-4f69-8d15-fefeaf6c7343 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:07.145110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478930a-99da-4f69-8d15-fefeaf6c7343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:07.155558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478930a-99da-4f69-8d15-fefeaf6c7343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:07.157152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478930a-99da-4f69-8d15-fefeaf6c7343 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:07.167142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1247/2483] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:07.266059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aba95-cb48-44d5-b9b4-4f90d2f3bb7b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:07.276059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aba95-cb48-44d5-b9b4-4f90d2f3bb7b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:07.280531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0d95c-5660-49b2-8c14-2c0c5787fe38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:07.281197 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d95c-5660-49b2-8c14-2c0c5787fe38 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:07.281463 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d95c-5660-49b2-8c14-2c0c5787fe38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:07.281773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0d95c-5660-49b2-8c14-2c0c5787fe38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:07.340023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0d95c-5660-49b2-8c14-2c0c5787fe38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:07.341992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0d95c-5660-49b2-8c14-2c0c5787fe38 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:07.350946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1237/2484] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:09.992308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478930a-99da-4f69-8d15-fefeaf6c7343 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:10.000546 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f9a83-4a6b-4764-bb13-abfce16a5697 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:10.001017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f9a83-4a6b-4764-bb13-abfce16a5697 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:10.001133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f9a83-4a6b-4764-bb13-abfce16a5697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:10.018146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3d2f9a83-4a6b-4764-bb13-abfce16a5697 None None] MFA Rules not processed for user `ad7271d8e9424bb7ad8ce1143fc71de9`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:10.019486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3d2f9a83-4a6b-4764-bb13-abfce16a5697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:10.052761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478930a-99da-4f69-8d15-fefeaf6c7343 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:10.057256 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:10.058151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:10.058435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:10.058709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] PATH_INFO: `/v3/users/ef1ff1842c6c42a28783c65a508829bc` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:10.060447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef1ff1842c6c42a28783c65a508829bc)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:10.062395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:10.074409 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1238/2485] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:43:10.109336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef1ff1842c6c42a28783c65a508829bc'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.120857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef1ff1842c6c42a28783c65a508829bc'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.128180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef1ff1842c6c42a28783c65a508829bc'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.128863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef1ff1842c6c42a28783c65a508829bc'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.136206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef1ff1842c6c42a28783c65a508829bc'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.142308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1248/2486] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:09 2022] DELETE /identity/v3/users/ef1ff1842c6c42a28783c65a508829bc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:10.146910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4172b3-a222-4c02-a9fa-f8a538784d52 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:10.147086 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4172b3-a222-4c02-a9fa-f8a538784d52 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:10.147375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4172b3-a222-4c02-a9fa-f8a538784d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:10.164801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5f4172b3-a222-4c02-a9fa-f8a538784d52 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:10.166627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5f4172b3-a222-4c02-a9fa-f8a538784d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:10.224797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1239/2487] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:43:10.235405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:10.236913 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:10.295241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6d4a7-3e3f-4f2e-a1c0-7e05bfacb996 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:10.298898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105843c2-52d3-49a8-ac29-7436e633d7c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:10.299539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105843c2-52d3-49a8-ac29-7436e633d7c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:10.299822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105843c2-52d3-49a8-ac29-7436e633d7c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:10.300096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105843c2-52d3-49a8-ac29-7436e633d7c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:10.309461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105843c2-52d3-49a8-ac29-7436e633d7c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:10.310952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105843c2-52d3-49a8-ac29-7436e633d7c3 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:10.320856 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1249/2488] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:43:10.592120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4172b3-a222-4c02-a9fa-f8a538784d52 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:10.593793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5f4172b3-a222-4c02-a9fa-f8a538784d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:10.609358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4172b3-a222-4c02-a9fa-f8a538784d52 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:10.614654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:10.615793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:10.616159 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:10.616508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] PATH_INFO: `/v3/projects/3a5b14bd451f4cf78fa9067887caff07` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:10.617870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5b14bd451f4cf78fa9067887caff07)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:10.620016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:10.672446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5b14bd451f4cf78fa9067887caff07', 'request_id': 'req-653df217-4873-431b-ac2b-3d671ad3b8bc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.684898 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5b14bd451f4cf78fa9067887caff07', 'request_id': 'req-653df217-4873-431b-ac2b-3d671ad3b8bc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.693846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5b14bd451f4cf78fa9067887caff07', 'request_id': 'req-653df217-4873-431b-ac2b-3d671ad3b8bc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.707313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] The token cache is being invalidate because project 3a5b14bd451f4cf78fa9067887caff07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:10.707919 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.708766 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.710569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1240/2489] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:10 2022] DELETE /identity/v3/projects/3a5b14bd451f4cf78fa9067887caff07 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:10.714658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105843c2-52d3-49a8-ac29-7436e633d7c3 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:10.732037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105843c2-52d3-49a8-ac29-7436e633d7c3 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:10.792109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:10.792994 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:10.793277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:10.793573 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] PATH_INFO: `/v3/users/f88d99122c2342aaa7db2356cc5c7ce7` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:10.794855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88d99122c2342aaa7db2356cc5c7ce7)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:10.796826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:10.843370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88d99122c2342aaa7db2356cc5c7ce7'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.856338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88d99122c2342aaa7db2356cc5c7ce7'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.863572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88d99122c2342aaa7db2356cc5c7ce7'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.864740 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88d99122c2342aaa7db2356cc5c7ce7'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.873046 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-36cf43e6-f8bc-46ea-9386-ea08d5a2ec0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88d99122c2342aaa7db2356cc5c7ce7'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:10.879163 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1250/2490] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:10 2022] DELETE /identity/v3/users/f88d99122c2342aaa7db2356cc5c7ce7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:43:11.176459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:11.178065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:11.202204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653df217-4873-431b-ac2b-3d671ad3b8bc admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:11.264799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:11.266925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.266925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.266925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] PATH_INFO: `/v3/projects/7d0614f4003e42c1ab60cf9504d8dd54` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.267854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0614f4003e42c1ab60cf9504d8dd54)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:11.275030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:11.322140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0614f4003e42c1ab60cf9504d8dd54', 'request_id': 'req-102cbf46-a2d8-4158-907a-5e0286224c6e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:11.327872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0614f4003e42c1ab60cf9504d8dd54', 'request_id': 'req-102cbf46-a2d8-4158-907a-5e0286224c6e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:11.334853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0614f4003e42c1ab60cf9504d8dd54', 'request_id': 'req-102cbf46-a2d8-4158-907a-5e0286224c6e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:11.345320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] The token cache is being invalidate because project 7d0614f4003e42c1ab60cf9504d8dd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:11.345632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:11.346255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-102cbf46-a2d8-4158-907a-5e0286224c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:11.347781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1241/2491] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:11 2022] DELETE /identity/v3/projects/7d0614f4003e42c1ab60cf9504d8dd54 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:11.352911 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e1bc-2136-4557-95e1-287c40d06716 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.353360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e1bc-2136-4557-95e1-287c40d06716 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.353485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e1bc-2136-4557-95e1-287c40d06716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.371328 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-3169e1bc-2136-4557-95e1-287c40d06716 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:11.373206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3169e1bc-2136-4557-95e1-287c40d06716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:11.428764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1251/2492] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:11.436974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61090f-e31f-4f8f-8485-e6de3b55bd14 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.437264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61090f-e31f-4f8f-8485-e6de3b55bd14 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.437559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61090f-e31f-4f8f-8485-e6de3b55bd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.455654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5b61090f-e31f-4f8f-8485-e6de3b55bd14 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:11.456777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5b61090f-e31f-4f8f-8485-e6de3b55bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:11.464757 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1242/2493] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:11.468900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e1bc-2136-4557-95e1-287c40d06716 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:11.478252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169e1bc-2136-4557-95e1-287c40d06716 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:11.483422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:11.484077 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.484360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.484635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.485357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:43:11.485687 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:11.487265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:11.499146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1252/2494] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:43:11.503357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61090f-e31f-4f8f-8485-e6de3b55bd14 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:11.512364 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61090f-e31f-4f8f-8485-e6de3b55bd14 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:11.517719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ab05-b735-44d9-8568-7de4db87a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:11.518370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ab05-b735-44d9-8568-7de4db87a0ce admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.518652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ab05-b735-44d9-8568-7de4db87a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.518929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ab05-b735-44d9-8568-7de4db87a0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.519622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ab05-b735-44d9-8568-7de4db87a0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:11.521679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ab05-b735-44d9-8568-7de4db87a0ce admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:11.547436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1243/2495] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:11 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:43:11.551706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:11.561292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0b70-8a33-4f2f-a24f-0dbe3fc44aac admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:11.620457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2df879-c938-4678-b92d-6272b1c2067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:11.621146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2df879-c938-4678-b92d-6272b1c2067a admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.621435 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2df879-c938-4678-b92d-6272b1c2067a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.621749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2df879-c938-4678-b92d-6272b1c2067a admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.622506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2df879-c938-4678-b92d-6272b1c2067a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:11.624832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2df879-c938-4678-b92d-6272b1c2067a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:11.649062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1253/2496] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:11 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:11.650574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ab05-b735-44d9-8568-7de4db87a0ce admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:11.662639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ab05-b735-44d9-8568-7de4db87a0ce admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:11.667954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2726fb-3920-4206-af5a-47c839beddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:11.668802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2726fb-3920-4206-af5a-47c839beddcf admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.669155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2726fb-3920-4206-af5a-47c839beddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.669432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2726fb-3920-4206-af5a-47c839beddcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.670233 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2726fb-3920-4206-af5a-47c839beddcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:11.672457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2726fb-3920-4206-af5a-47c839beddcf admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:11.687339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1244/2497] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:11.688571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2df879-c938-4678-b92d-6272b1c2067a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:11.699051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2df879-c938-4678-b92d-6272b1c2067a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:11.704440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d334681-d44d-4faf-bc93-0ad4d23b34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:11.705379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334681-d44d-4faf-bc93-0ad4d23b34f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.705852 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334681-d44d-4faf-bc93-0ad4d23b34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.706135 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334681-d44d-4faf-bc93-0ad4d23b34f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.706939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d334681-d44d-4faf-bc93-0ad4d23b34f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:11.708631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d334681-d44d-4faf-bc93-0ad4d23b34f4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:11.719662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1254/2498] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:11.724868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2726fb-3920-4206-af5a-47c839beddcf admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:11.734695 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2726fb-3920-4206-af5a-47c839beddcf admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:11.739541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb5cb6-a25b-41c2-a518-d6481e6e2f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:11.740466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5cb6-a25b-41c2-a518-d6481e6e2f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.740753 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5cb6-a25b-41c2-a518-d6481e6e2f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.741031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb5cb6-a25b-41c2-a518-d6481e6e2f75 admin admin] PATH_INFO: `/v3/projects/38a10b01e2fd461b86848c9950d56236/users/e017395ccdaa4f2cb9e539cfdfe22a8f/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.757606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb5cb6-a25b-41c2-a518-d6481e6e2f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a10b01e2fd461b86848c9950d56236, user_id=e017395ccdaa4f2cb9e539cfdfe22a8f, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:11.760502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb5cb6-a25b-41c2-a518-d6481e6e2f75 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:11.780071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1245/2499] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:11 2022] PUT /identity/v3/projects/38a10b01e2fd461b86848c9950d56236/users/e017395ccdaa4f2cb9e539cfdfe22a8f/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:11.790467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9fb7d-250b-4a36-b388-c3e7f9315f86 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.791450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9fb7d-250b-4a36-b388-c3e7f9315f86 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.791799 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9fb7d-250b-4a36-b388-c3e7f9315f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.823059 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d0c9fb7d-250b-4a36-b388-c3e7f9315f86 None None] MFA Rules not processed for user `e017395ccdaa4f2cb9e539cfdfe22a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:11.824282 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d0c9fb7d-250b-4a36-b388-c3e7f9315f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:11.887882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1255/2500] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:11.893039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb5cb6-a25b-41c2-a518-d6481e6e2f75 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:11.953479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb5cb6-a25b-41c2-a518-d6481e6e2f75 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:11.959382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ac502-3cb2-4199-ace4-f9e23acdcc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:11.959952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ac502-3cb2-4199-ace4-f9e23acdcc60 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:11.960299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ac502-3cb2-4199-ace4-f9e23acdcc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:11.960608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ac502-3cb2-4199-ace4-f9e23acdcc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:11.961532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ac502-3cb2-4199-ace4-f9e23acdcc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:11.963840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ac502-3cb2-4199-ace4-f9e23acdcc60 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:11.992985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1246/2501] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:11 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:11.994426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9fb7d-250b-4a36-b388-c3e7f9315f86 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:12.005465 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9fb7d-250b-4a36-b388-c3e7f9315f86 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:12.071538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272b9c-4c86-408c-9eee-1f20b49dcdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:12.073216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272b9c-4c86-408c-9eee-1f20b49dcdfd admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.073216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272b9c-4c86-408c-9eee-1f20b49dcdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.073216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272b9c-4c86-408c-9eee-1f20b49dcdfd admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.073752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62272b9c-4c86-408c-9eee-1f20b49dcdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:12.076405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62272b9c-4c86-408c-9eee-1f20b49dcdfd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:12.099279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1256/2502] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:11 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:12.103343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ac502-3cb2-4199-ace4-f9e23acdcc60 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:12.115222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ac502-3cb2-4199-ace4-f9e23acdcc60 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:12.120714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1dde3-3978-40db-91e3-b4ed00bf2f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:12.121503 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1dde3-3978-40db-91e3-b4ed00bf2f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.121751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1dde3-3978-40db-91e3-b4ed00bf2f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.122013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1dde3-3978-40db-91e3-b4ed00bf2f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.123676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1dde3-3978-40db-91e3-b4ed00bf2f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:12.131801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1dde3-3978-40db-91e3-b4ed00bf2f19 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:12.154504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1247/2503] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:12.155797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272b9c-4c86-408c-9eee-1f20b49dcdfd admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:12.171128 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272b9c-4c86-408c-9eee-1f20b49dcdfd admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:12.176278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca46fdf-5f59-4aaa-9a9f-9ad5ed56d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:12.184795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46fdf-5f59-4aaa-9a9f-9ad5ed56d800 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.186332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46fdf-5f59-4aaa-9a9f-9ad5ed56d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.186332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46fdf-5f59-4aaa-9a9f-9ad5ed56d800 admin admin] PATH_INFO: `/v3/projects/ed981564b0c24237a72122c9277343c3/users/31d896b47aa5477f9eba94c38af7aa0f/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.204050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca46fdf-5f59-4aaa-9a9f-9ad5ed56d800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed981564b0c24237a72122c9277343c3, user_id=31d896b47aa5477f9eba94c38af7aa0f, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:12.207090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca46fdf-5f59-4aaa-9a9f-9ad5ed56d800 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:12.221222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1257/2504] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:12 2022] PUT /identity/v3/projects/ed981564b0c24237a72122c9277343c3/users/31d896b47aa5477f9eba94c38af7aa0f/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:12.225008 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1dde3-3978-40db-91e3-b4ed00bf2f19 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:12.237665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1dde3-3978-40db-91e3-b4ed00bf2f19 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:12.298891 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b9bec-db8e-46fb-aecf-0df03f4b0a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:12.300024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9bec-db8e-46fb-aecf-0df03f4b0a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.300354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9bec-db8e-46fb-aecf-0df03f4b0a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.300631 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9bec-db8e-46fb-aecf-0df03f4b0a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.301674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b9bec-db8e-46fb-aecf-0df03f4b0a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:12.303282 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b9bec-db8e-46fb-aecf-0df03f4b0a6a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:12.322347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca46fdf-5f59-4aaa-9a9f-9ad5ed56d800 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:12.329349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1248/2505] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:43:12.335818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca46fdf-5f59-4aaa-9a9f-9ad5ed56d800 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:12.341001 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:12.342263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.342647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.343025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] PATH_INFO: `/v3/projects/ed981564b0c24237a72122c9277343c3/users/31d896b47aa5477f9eba94c38af7aa0f/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.345276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed981564b0c24237a72122c9277343c3, user_id=31d896b47aa5477f9eba94c38af7aa0f, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:12.348422 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:12.363265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1258/2506] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:12 2022] PUT /identity/v3/projects/ed981564b0c24237a72122c9277343c3/users/31d896b47aa5477f9eba94c38af7aa0f/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:43:12.380663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ea03-f3f7-4d3d-bf9b-f49736b7e57d None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.380663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ea03-f3f7-4d3d-bf9b-f49736b7e57d None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.381205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7ea03-f3f7-4d3d-bf9b-f49736b7e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.417906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-5bd7ea03-f3f7-4d3d-bf9b-f49736b7e57d None None] MFA Rules not processed for user `31d896b47aa5477f9eba94c38af7aa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:12.419659 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5bd7ea03-f3f7-4d3d-bf9b-f49736b7e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:12.518297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1249/2507] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:12.530130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:12.532056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:12.599157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62949ff-f86b-4805-b138-1478a8ec3f70 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:12.604930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97209997-f943-4104-a8a1-fbafc9cf54ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:12.605820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97209997-f943-4104-a8a1-fbafc9cf54ff service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.606101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97209997-f943-4104-a8a1-fbafc9cf54ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.606368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97209997-f943-4104-a8a1-fbafc9cf54ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.618993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97209997-f943-4104-a8a1-fbafc9cf54ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:12.620676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97209997-f943-4104-a8a1-fbafc9cf54ff service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:12.631226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1259/2508] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:12.779707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ea03-f3f7-4d3d-bf9b-f49736b7e57d None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:12.849978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7ea03-f3f7-4d3d-bf9b-f49736b7e57d None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:12.854872 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:12.856623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.856623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.856623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] PATH_INFO: `/v3/users/e017395ccdaa4f2cb9e539cfdfe22a8f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.858441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e017395ccdaa4f2cb9e539cfdfe22a8f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:12.860721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:12.912630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e017395ccdaa4f2cb9e539cfdfe22a8f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:12.927677 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e017395ccdaa4f2cb9e539cfdfe22a8f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:12.928469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e017395ccdaa4f2cb9e539cfdfe22a8f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:12.935562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e017395ccdaa4f2cb9e539cfdfe22a8f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:12.936245 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e017395ccdaa4f2cb9e539cfdfe22a8f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:12.958530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1250/2509] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:12 2022] DELETE /identity/v3/users/e017395ccdaa4f2cb9e539cfdfe22a8f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:12.963452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95d30b-5efb-44ac-9ea1-25707298654f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:12.964115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95d30b-5efb-44ac-9ea1-25707298654f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:12.964668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95d30b-5efb-44ac-9ea1-25707298654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:12.989090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-3b95d30b-5efb-44ac-9ea1-25707298654f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:12.991181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3b95d30b-5efb-44ac-9ea1-25707298654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:13.061881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1260/2510] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:13.076540 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:13.078442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:13.148469 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c603-c65a-4c88-9552-37b27c70d299 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:13.152856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63f82c-a61d-4341-8e79-a3e5d620bf88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:13.154474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f82c-a61d-4341-8e79-a3e5d620bf88 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:13.155128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f82c-a61d-4341-8e79-a3e5d620bf88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:13.155536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f82c-a61d-4341-8e79-a3e5d620bf88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:13.166640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63f82c-a61d-4341-8e79-a3e5d620bf88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:13.168313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63f82c-a61d-4341-8e79-a3e5d620bf88 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:13.179905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1251/2511] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:43:13.925268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95d30b-5efb-44ac-9ea1-25707298654f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:13.926769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3b95d30b-5efb-44ac-9ea1-25707298654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:13.951904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95d30b-5efb-44ac-9ea1-25707298654f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:13.958583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:13.958900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:13.959240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:13.960756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] PATH_INFO: `/v3/projects/38a10b01e2fd461b86848c9950d56236` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:13.962535 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a10b01e2fd461b86848c9950d56236)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:13.964376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:14.010577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a10b01e2fd461b86848c9950d56236', 'request_id': 'req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.016017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a10b01e2fd461b86848c9950d56236', 'request_id': 'req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.024491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a10b01e2fd461b86848c9950d56236', 'request_id': 'req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.036268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] The token cache is being invalidate because project 38a10b01e2fd461b86848c9950d56236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:14.036479 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.037104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.038666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1261/2512] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:13 2022] DELETE /identity/v3/projects/38a10b01e2fd461b86848c9950d56236 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:14.042781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63f82c-a61d-4341-8e79-a3e5d620bf88 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:14.053279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63f82c-a61d-4341-8e79-a3e5d620bf88 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:14.108024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:14.108890 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.109170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.109442 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] PATH_INFO: `/v3/users/31d896b47aa5477f9eba94c38af7aa0f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.110666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d896b47aa5477f9eba94c38af7aa0f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:14.112528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:14.159504 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d896b47aa5477f9eba94c38af7aa0f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.171420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d896b47aa5477f9eba94c38af7aa0f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.172118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d896b47aa5477f9eba94c38af7aa0f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.178611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d896b47aa5477f9eba94c38af7aa0f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.179231 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-fc696898-5fc4-4392-89c0-31a37cee005d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d896b47aa5477f9eba94c38af7aa0f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.191899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1252/2513] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:14 2022] DELETE /identity/v3/users/31d896b47aa5477f9eba94c38af7aa0f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:14.495370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:14.497038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:14.509971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcff7f-8ad6-4dfa-af8a-e48e730ea038 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:14.565079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:14.566299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.566589 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.566866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] PATH_INFO: `/v3/projects/ed981564b0c24237a72122c9277343c3` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.568038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed981564b0c24237a72122c9277343c3)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:14.569980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:14.614101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed981564b0c24237a72122c9277343c3', 'request_id': 'req-0fff7ea9-126c-431e-b4ae-2054d01db187'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.619365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed981564b0c24237a72122c9277343c3', 'request_id': 'req-0fff7ea9-126c-431e-b4ae-2054d01db187'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.626290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed981564b0c24237a72122c9277343c3', 'request_id': 'req-0fff7ea9-126c-431e-b4ae-2054d01db187'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.636999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] The token cache is being invalidate because project ed981564b0c24237a72122c9277343c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:14.637455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.638615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0fff7ea9-126c-431e-b4ae-2054d01db187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:14.640251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1262/2514] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:14 2022] DELETE /identity/v3/projects/ed981564b0c24237a72122c9277343c3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:14.645371 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5841-8e84-402d-a787-b48d5d0f0955 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.645751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5841-8e84-402d-a787-b48d5d0f0955 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.646199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5841-8e84-402d-a787-b48d5d0f0955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.664630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0b5e5841-8e84-402d-a787-b48d5d0f0955 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:14.666003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0b5e5841-8e84-402d-a787-b48d5d0f0955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:14.725628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1253/2515] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:14.733287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676045c-28b3-46ab-8e7d-63d0c7acabb4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.733592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676045c-28b3-46ab-8e7d-63d0c7acabb4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.733875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676045c-28b3-46ab-8e7d-63d0c7acabb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.752828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9676045c-28b3-46ab-8e7d-63d0c7acabb4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:14.754215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9676045c-28b3-46ab-8e7d-63d0c7acabb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:14.762209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1263/2516] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:14.766799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5841-8e84-402d-a787-b48d5d0f0955 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:14.776379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5841-8e84-402d-a787-b48d5d0f0955 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:14.781055 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:14.781740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.782027 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.782302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.783028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:43:14.783338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:14.784931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:14.796394 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1254/2517] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:43:14.800613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676045c-28b3-46ab-8e7d-63d0c7acabb4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:14.810290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676045c-28b3-46ab-8e7d-63d0c7acabb4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:14.815055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2067654-a7ba-4092-b82d-fceb10c5b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:14.815708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067654-a7ba-4092-b82d-fceb10c5b5ab admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.816261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067654-a7ba-4092-b82d-fceb10c5b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.816539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2067654-a7ba-4092-b82d-fceb10c5b5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.817220 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2067654-a7ba-4092-b82d-fceb10c5b5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:14.819161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2067654-a7ba-4092-b82d-fceb10c5b5ab admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:14.844647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1264/2518] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:14 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:14.848622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:14.858569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af94e-e8e8-4942-8b7b-ab86ee1822cb admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:14.912081 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ddee-a866-49e7-a8db-1bd77f435bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:14.912737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ddee-a866-49e7-a8db-1bd77f435bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.913022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ddee-a866-49e7-a8db-1bd77f435bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.913303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14ddee-a866-49e7-a8db-1bd77f435bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.914023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14ddee-a866-49e7-a8db-1bd77f435bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:14.915940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14ddee-a866-49e7-a8db-1bd77f435bc4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:14.935390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1255/2519] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:14 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:14.939352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2067654-a7ba-4092-b82d-fceb10c5b5ab admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:14.949650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2067654-a7ba-4092-b82d-fceb10c5b5ab admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:14.954927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3105154-413d-4df4-a106-05c8f59b8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:14.955655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3105154-413d-4df4-a106-05c8f59b8336 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.955941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3105154-413d-4df4-a106-05c8f59b8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.956216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3105154-413d-4df4-a106-05c8f59b8336 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.956938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3105154-413d-4df4-a106-05c8f59b8336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:14.958987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3105154-413d-4df4-a106-05c8f59b8336 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:14.970639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1265/2520] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:14.974605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ddee-a866-49e7-a8db-1bd77f435bc4 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:14.984630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14ddee-a866-49e7-a8db-1bd77f435bc4 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:14.989278 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2af30-7e25-49e3-87dc-726bf13a056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:14.989967 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2af30-7e25-49e3-87dc-726bf13a056f admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:14.990254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2af30-7e25-49e3-87dc-726bf13a056f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:14.990531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2af30-7e25-49e3-87dc-726bf13a056f admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:14.991252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2af30-7e25-49e3-87dc-726bf13a056f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:14.992876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2af30-7e25-49e3-87dc-726bf13a056f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.003716 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1256/2521] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:15.007761 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3105154-413d-4df4-a106-05c8f59b8336 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.018423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3105154-413d-4df4-a106-05c8f59b8336 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.023040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56b9b-b458-46aa-8040-55207698b5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.024051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56b9b-b458-46aa-8040-55207698b5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.024334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56b9b-b458-46aa-8040-55207698b5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.024611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd56b9b-b458-46aa-8040-55207698b5d4 admin admin] PATH_INFO: `/v3/projects/3d5d10b6a1944e86a16cf35f4ce9041e/users/5f6315aac91b4c1c9ee784edad13a36c/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.039169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd56b9b-b458-46aa-8040-55207698b5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5d10b6a1944e86a16cf35f4ce9041e, user_id=5f6315aac91b4c1c9ee784edad13a36c, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.041876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd56b9b-b458-46aa-8040-55207698b5d4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.056324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1266/2522] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:15 2022] PUT /identity/v3/projects/3d5d10b6a1944e86a16cf35f4ce9041e/users/5f6315aac91b4c1c9ee784edad13a36c/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:15.067605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e37a3-f7e6-422c-84e3-ec53e30282d8 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.068094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e37a3-f7e6-422c-84e3-ec53e30282d8 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.068214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e37a3-f7e6-422c-84e3-ec53e30282d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.094639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8f0e37a3-f7e6-422c-84e3-ec53e30282d8 None None] MFA Rules not processed for user `5f6315aac91b4c1c9ee784edad13a36c`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:15.095933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8f0e37a3-f7e6-422c-84e3-ec53e30282d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:15.158786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1257/2523] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:15.163073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56b9b-b458-46aa-8040-55207698b5d4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.223533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd56b9b-b458-46aa-8040-55207698b5d4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.228260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406a51-6139-44d1-848a-264f9bba59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.228917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406a51-6139-44d1-848a-264f9bba59c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.229200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406a51-6139-44d1-848a-264f9bba59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.229475 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406a51-6139-44d1-848a-264f9bba59c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.230201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406a51-6139-44d1-848a-264f9bba59c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.232652 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406a51-6139-44d1-848a-264f9bba59c0 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.258645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1267/2524] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:15 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:15.262585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e37a3-f7e6-422c-84e3-ec53e30282d8 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.273474 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e37a3-f7e6-422c-84e3-ec53e30282d8 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.329432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67819051-a688-4286-81fa-cf8b4a9e1ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.331095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819051-a688-4286-81fa-cf8b4a9e1ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.331379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819051-a688-4286-81fa-cf8b4a9e1ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.331655 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819051-a688-4286-81fa-cf8b4a9e1ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.332344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67819051-a688-4286-81fa-cf8b4a9e1ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.334293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67819051-a688-4286-81fa-cf8b4a9e1ed5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.358076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1258/2525] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:15 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:15.361728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406a51-6139-44d1-848a-264f9bba59c0 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.373380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406a51-6139-44d1-848a-264f9bba59c0 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.378295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86bd7-6da0-4f0a-8c06-15f4915b3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.379042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86bd7-6da0-4f0a-8c06-15f4915b3260 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.379420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86bd7-6da0-4f0a-8c06-15f4915b3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.379768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86bd7-6da0-4f0a-8c06-15f4915b3260 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.380565 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d86bd7-6da0-4f0a-8c06-15f4915b3260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.382348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d86bd7-6da0-4f0a-8c06-15f4915b3260 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.393957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1268/2526] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:15.398258 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67819051-a688-4286-81fa-cf8b4a9e1ed5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.408851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67819051-a688-4286-81fa-cf8b4a9e1ed5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.413773 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d0cd5-221e-4c18-94dc-60dc36dd9661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.414590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d0cd5-221e-4c18-94dc-60dc36dd9661 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.414873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d0cd5-221e-4c18-94dc-60dc36dd9661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.415147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d0cd5-221e-4c18-94dc-60dc36dd9661 admin admin] PATH_INFO: `/v3/projects/7b8654436c2b4447b929510f17096e2c/users/3712eab745124768b504d37fba00b8d2/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.430648 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d0cd5-221e-4c18-94dc-60dc36dd9661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8654436c2b4447b929510f17096e2c, user_id=3712eab745124768b504d37fba00b8d2, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.433307 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d0cd5-221e-4c18-94dc-60dc36dd9661 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.451547 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1259/2527] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:15 2022] PUT /identity/v3/projects/7b8654436c2b4447b929510f17096e2c/users/3712eab745124768b504d37fba00b8d2/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:15.457741 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86bd7-6da0-4f0a-8c06-15f4915b3260 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.474083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86bd7-6da0-4f0a-8c06-15f4915b3260 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.531491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35d37-601d-4534-b7f4-ec7033e9a904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.532151 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35d37-601d-4534-b7f4-ec7033e9a904 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.532432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35d37-601d-4534-b7f4-ec7033e9a904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.532705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35d37-601d-4534-b7f4-ec7033e9a904 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.533407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb35d37-601d-4534-b7f4-ec7033e9a904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.535031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb35d37-601d-4534-b7f4-ec7033e9a904 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.544910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1269/2528] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:15.549257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d0cd5-221e-4c18-94dc-60dc36dd9661 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.559502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d0cd5-221e-4c18-94dc-60dc36dd9661 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.564192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.565093 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.565381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.565702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] PATH_INFO: `/v3/projects/7b8654436c2b4447b929510f17096e2c/users/3712eab745124768b504d37fba00b8d2/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.567960 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8654436c2b4447b929510f17096e2c, user_id=3712eab745124768b504d37fba00b8d2, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.570629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.580803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1260/2529] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:15 2022] PUT /identity/v3/projects/7b8654436c2b4447b929510f17096e2c/users/3712eab745124768b504d37fba00b8d2/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:15.592364 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ca2f-ff2d-4937-be0f-4fd4e71389ac None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.592660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ca2f-ff2d-4937-be0f-4fd4e71389ac None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.592942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607ca2f-ff2d-4937-be0f-4fd4e71389ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.619884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-6607ca2f-ff2d-4937-be0f-4fd4e71389ac None None] MFA Rules not processed for user `3712eab745124768b504d37fba00b8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:15.621100 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6607ca2f-ff2d-4937-be0f-4fd4e71389ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:15.684974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1270/2530] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:15.697158 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.698917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:15.761881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f1fce-15ee-4649-bc50-2a9838f80a0f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.765472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36d7e-2826-423c-8ace-dba835e4c981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.766147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36d7e-2826-423c-8ace-dba835e4c981 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.766426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36d7e-2826-423c-8ace-dba835e4c981 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.766701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36d7e-2826-423c-8ace-dba835e4c981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.775396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c36d7e-2826-423c-8ace-dba835e4c981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.776826 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c36d7e-2826-423c-8ace-dba835e4c981 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.786508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1261/2531] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:15.867197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607ca2f-ff2d-4937-be0f-4fd4e71389ac None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:15.876645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607ca2f-ff2d-4937-be0f-4fd4e71389ac None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:15.880185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a050352-1eee-466f-a2aa-408a77c0c8c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:15.880820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a050352-1eee-466f-a2aa-408a77c0c8c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:15.881099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a050352-1eee-466f-a2aa-408a77c0c8c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:15.881369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a050352-1eee-466f-a2aa-408a77c0c8c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:15.936000 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a050352-1eee-466f-a2aa-408a77c0c8c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:15.937355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a050352-1eee-466f-a2aa-408a77c0c8c4 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:15.946461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1271/2532] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:20.598643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36d7e-2826-423c-8ace-dba835e4c981 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:20.658660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36d7e-2826-423c-8ace-dba835e4c981 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:20.663508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:20.664843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:20.665128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:20.665403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] PATH_INFO: `/v3/users/5f6315aac91b4c1c9ee784edad13a36c` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:20.666712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6315aac91b4c1c9ee784edad13a36c)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:20.668683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:20.715731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6315aac91b4c1c9ee784edad13a36c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:20.727172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6315aac91b4c1c9ee784edad13a36c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:20.727824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6315aac91b4c1c9ee784edad13a36c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:20.735220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6315aac91b4c1c9ee784edad13a36c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:20.735856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6315aac91b4c1c9ee784edad13a36c'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:20.747665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1262/2533] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:20 2022] DELETE /identity/v3/users/5f6315aac91b4c1c9ee784edad13a36c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:20.752142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86c5d-c99a-4bfb-8894-54afb1902365 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:20.752615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86c5d-c99a-4bfb-8894-54afb1902365 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:20.752712 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86c5d-c99a-4bfb-8894-54afb1902365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:20.769747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-82e86c5d-c99a-4bfb-8894-54afb1902365 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:20.770939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-82e86c5d-c99a-4bfb-8894-54afb1902365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:20.826672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1272/2534] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:20.836264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:20.837681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:20.892274 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880f123-520a-4244-96e1-e5d0eb74d78b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:20.895924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88300c71-86bb-4aef-b201-430e67912abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:20.896557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300c71-86bb-4aef-b201-430e67912abe service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:20.896841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300c71-86bb-4aef-b201-430e67912abe service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:20.897122 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300c71-86bb-4aef-b201-430e67912abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:20.906392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88300c71-86bb-4aef-b201-430e67912abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:20.907809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88300c71-86bb-4aef-b201-430e67912abe service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:20.916906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1263/2535] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:21.232329 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86c5d-c99a-4bfb-8894-54afb1902365 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:21.233825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-82e86c5d-c99a-4bfb-8894-54afb1902365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:21.245525 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86c5d-c99a-4bfb-8894-54afb1902365 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:21.259146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:21.261726 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:21.262114 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:21.262875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] PATH_INFO: `/v3/projects/3d5d10b6a1944e86a16cf35f4ce9041e` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:21.265320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5d10b6a1944e86a16cf35f4ce9041e)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:21.267489 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:21.314996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5d10b6a1944e86a16cf35f4ce9041e', 'request_id': 'req-af97d286-eb78-480c-bef2-0358860c6652'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.321113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5d10b6a1944e86a16cf35f4ce9041e', 'request_id': 'req-af97d286-eb78-480c-bef2-0358860c6652'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.329368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5d10b6a1944e86a16cf35f4ce9041e', 'request_id': 'req-af97d286-eb78-480c-bef2-0358860c6652'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.343968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] The token cache is being invalidate because project 3d5d10b6a1944e86a16cf35f4ce9041e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:21.344496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.345488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.347371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1273/2536] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:21 2022] DELETE /identity/v3/projects/3d5d10b6a1944e86a16cf35f4ce9041e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:21.351222 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88300c71-86bb-4aef-b201-430e67912abe service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:21.362771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88300c71-86bb-4aef-b201-430e67912abe service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:21.418134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:21.419006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:21.419293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:21.419600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] PATH_INFO: `/v3/users/3712eab745124768b504d37fba00b8d2` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:21.420820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3712eab745124768b504d37fba00b8d2)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:21.422771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:21.471248 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3712eab745124768b504d37fba00b8d2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.483153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3712eab745124768b504d37fba00b8d2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.484921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3712eab745124768b504d37fba00b8d2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.491243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3712eab745124768b504d37fba00b8d2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.491885 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0e96426f-da0b-433c-a801-bff7ab86de01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3712eab745124768b504d37fba00b8d2'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:21.505858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1264/2537] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:21 2022] DELETE /identity/v3/users/3712eab745124768b504d37fba00b8d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:22.298216 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:22.300347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:22.315447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97d286-eb78-480c-bef2-0358860c6652 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:22.373512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:22.374403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.374685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.374955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] PATH_INFO: `/v3/projects/7b8654436c2b4447b929510f17096e2c` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.376143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8654436c2b4447b929510f17096e2c)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:22.378104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:22.421477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8654436c2b4447b929510f17096e2c', 'request_id': 'req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:22.426630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8654436c2b4447b929510f17096e2c', 'request_id': 'req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:22.434676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8654436c2b4447b929510f17096e2c', 'request_id': 'req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:22.446993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] The token cache is being invalidate because project 7b8654436c2b4447b929510f17096e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:22.447284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:22.448056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-84ee255c-5295-4fdd-a2ae-f8fedfe30e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:22.449855 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1274/2538] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:22 2022] DELETE /identity/v3/projects/7b8654436c2b4447b929510f17096e2c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:22.458091 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0609a-68bf-4626-bc58-35621308176a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.458615 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0609a-68bf-4626-bc58-35621308176a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.458698 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0609a-68bf-4626-bc58-35621308176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.476864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-78e0609a-68bf-4626-bc58-35621308176a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:22.478111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-78e0609a-68bf-4626-bc58-35621308176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:22.544103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1265/2539] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:22.552099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8794d83-b891-4111-9c83-e5b2519500c6 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.552390 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8794d83-b891-4111-9c83-e5b2519500c6 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.552737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8794d83-b891-4111-9c83-e5b2519500c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.571331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-c8794d83-b891-4111-9c83-e5b2519500c6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:22.572532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c8794d83-b891-4111-9c83-e5b2519500c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:22.580960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1275/2540] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:22.585283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0609a-68bf-4626-bc58-35621308176a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:22.594901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0609a-68bf-4626-bc58-35621308176a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:22.599446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:22.600099 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.600381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.600658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.601378 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:43:22.601716 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:22.603322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:22.615447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1266/2541] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:43:22.619653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8794d83-b891-4111-9c83-e5b2519500c6 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:22.629431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8794d83-b891-4111-9c83-e5b2519500c6 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:22.634530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47523e2e-8392-4819-87b0-9db14cba5ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:22.635185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47523e2e-8392-4819-87b0-9db14cba5ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.635466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47523e2e-8392-4819-87b0-9db14cba5ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.635742 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47523e2e-8392-4819-87b0-9db14cba5ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.636441 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47523e2e-8392-4819-87b0-9db14cba5ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:22.638424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47523e2e-8392-4819-87b0-9db14cba5ce5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:22.663379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1276/2542] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:22 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:22.667809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:22.678544 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d1721-7bd8-4fa7-9d26-a1860d0749c8 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:22.734546 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8df95-e2bd-4248-b28f-99e47413b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:22.735218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8df95-e2bd-4248-b28f-99e47413b312 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.735497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8df95-e2bd-4248-b28f-99e47413b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.735772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8df95-e2bd-4248-b28f-99e47413b312 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.736460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8df95-e2bd-4248-b28f-99e47413b312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:22.738453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8df95-e2bd-4248-b28f-99e47413b312 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:22.759743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1267/2543] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:22 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:22.763951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47523e2e-8392-4819-87b0-9db14cba5ce5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:22.774810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47523e2e-8392-4819-87b0-9db14cba5ce5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:22.779539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e125c-767f-4660-8290-a27c771d671b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:22.780342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e125c-767f-4660-8290-a27c771d671b admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.780648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e125c-767f-4660-8290-a27c771d671b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.780921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e125c-767f-4660-8290-a27c771d671b admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.781678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e125c-767f-4660-8290-a27c771d671b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:22.783335 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e125c-767f-4660-8290-a27c771d671b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:22.803974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1277/2544] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:22.807847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8df95-e2bd-4248-b28f-99e47413b312 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:22.819169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8df95-e2bd-4248-b28f-99e47413b312 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:22.823930 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3cde-99cb-4ab9-8ef1-72ba39d5ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:22.824603 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3cde-99cb-4ab9-8ef1-72ba39d5ffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.827456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3cde-99cb-4ab9-8ef1-72ba39d5ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.827456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3cde-99cb-4ab9-8ef1-72ba39d5ffa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.827456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3cde-99cb-4ab9-8ef1-72ba39d5ffa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:22.828000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3cde-99cb-4ab9-8ef1-72ba39d5ffa9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:22.840011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1268/2545] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:43:22.844130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e125c-767f-4660-8290-a27c771d671b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:22.854392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e125c-767f-4660-8290-a27c771d671b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:22.861499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:22.862095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.862376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.862649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] PATH_INFO: `/v3/projects/0d4a1b1523d14c56a2efcd874152cbb8/users/d2f4494f0a2b40e08b4f2f404c6f811f/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.879929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4a1b1523d14c56a2efcd874152cbb8, user_id=d2f4494f0a2b40e08b4f2f404c6f811f, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:22.883028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:22.898360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1278/2546] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:22 2022] PUT /identity/v3/projects/0d4a1b1523d14c56a2efcd874152cbb8/users/d2f4494f0a2b40e08b4f2f404c6f811f/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:22.909688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ebde-ea14-4b61-8465-1ecd6d7ac6f6 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:22.910012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ebde-ea14-4b61-8465-1ecd6d7ac6f6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:22.910281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ebde-ea14-4b61-8465-1ecd6d7ac6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:22.939901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2cf6ebde-ea14-4b61-8465-1ecd6d7ac6f6 None None] MFA Rules not processed for user `d2f4494f0a2b40e08b4f2f404c6f811f`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:22.941354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2cf6ebde-ea14-4b61-8465-1ecd6d7ac6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.009738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1269/2547] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:23.020583 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:23.022472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.082111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1c33-e794-4f7f-bbb4-9b5c5e883960 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:23.086890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601a658-a868-4aec-80bd-8d82ea958a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:23.087657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a658-a868-4aec-80bd-8d82ea958a93 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:23.088058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a658-a868-4aec-80bd-8d82ea958a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:23.088396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a658-a868-4aec-80bd-8d82ea958a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:23.098230 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601a658-a868-4aec-80bd-8d82ea958a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:23.099686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601a658-a868-4aec-80bd-8d82ea958a93 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:23.109711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1279/2548] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:23.129003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6ebde-ea14-4b61-8465-1ecd6d7ac6f6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:23.192413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6ebde-ea14-4b61-8465-1ecd6d7ac6f6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:23.198017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:23.199095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:23.199384 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:23.199876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] PATH_INFO: `/v3/users/d2f4494f0a2b40e08b4f2f404c6f811f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:23.201649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f4494f0a2b40e08b4f2f404c6f811f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:23.203393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:23.252697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f4494f0a2b40e08b4f2f404c6f811f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.265774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f4494f0a2b40e08b4f2f404c6f811f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.266536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f4494f0a2b40e08b4f2f404c6f811f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.273881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f4494f0a2b40e08b4f2f404c6f811f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.274638 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f4494f0a2b40e08b4f2f404c6f811f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.292740 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1270/2549] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:23 2022] DELETE /identity/v3/users/d2f4494f0a2b40e08b4f2f404c6f811f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:23.294277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f218be-cdb0-480c-a53d-40e369234471 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:23.294545 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f218be-cdb0-480c-a53d-40e369234471 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:23.294829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f218be-cdb0-480c-a53d-40e369234471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:23.317086 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-b8f218be-cdb0-480c-a53d-40e369234471 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:23.318386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b8f218be-cdb0-480c-a53d-40e369234471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.336280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:23.337624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.390001 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1280/2550] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:43:23.403051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f218be-cdb0-480c-a53d-40e369234471 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:23.407083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b8f218be-cdb0-480c-a53d-40e369234471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.408574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2552f-5d93-435d-812a-11b1033f888c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:23.417326 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749fdfc-42b0-47e7-a39a-c7c5af8c79b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:23.418332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749fdfc-42b0-47e7-a39a-c7c5af8c79b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:23.418979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749fdfc-42b0-47e7-a39a-c7c5af8c79b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:23.420010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749fdfc-42b0-47e7-a39a-c7c5af8c79b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:23.422381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8749fdfc-42b0-47e7-a39a-c7c5af8c79b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.427053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f218be-cdb0-480c-a53d-40e369234471 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:23.434130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:23.436313 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:23.436759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:23.438130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:23.454347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:23.456409 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:23.468013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1281/2551] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:23.512328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749fdfc-42b0-47e7-a39a-c7c5af8c79b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:23.513846 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749fdfc-42b0-47e7-a39a-c7c5af8c79b5 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:23.526678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1271/2552] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:43:23.757980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:23.759495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.775537 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c58d08-f5dd-4edf-92e6-b3f3984f742e service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:23.781021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:23.782097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:23.782498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:23.782956 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] PATH_INFO: `/v3/projects/0d4a1b1523d14c56a2efcd874152cbb8` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:23.784298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4a1b1523d14c56a2efcd874152cbb8)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:23.786729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:23.836034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4a1b1523d14c56a2efcd874152cbb8', 'request_id': 'req-b4cfd59c-a3ae-418c-8322-5fbd030073aa'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.842473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4a1b1523d14c56a2efcd874152cbb8', 'request_id': 'req-b4cfd59c-a3ae-418c-8322-5fbd030073aa'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.850057 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4a1b1523d14c56a2efcd874152cbb8', 'request_id': 'req-b4cfd59c-a3ae-418c-8322-5fbd030073aa'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.861731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] The token cache is being invalidate because project 0d4a1b1523d14c56a2efcd874152cbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:23.862125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.862716 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b4cfd59c-a3ae-418c-8322-5fbd030073aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:23.864290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1282/2553] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:23 2022] DELETE /identity/v3/projects/0d4a1b1523d14c56a2efcd874152cbb8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:23.869668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46fcfc-403d-4489-8a13-90156c5b702a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:23.870053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46fcfc-403d-4489-8a13-90156c5b702a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:23.870332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46fcfc-403d-4489-8a13-90156c5b702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:23.887526 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8a46fcfc-403d-4489-8a13-90156c5b702a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:23.888736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8a46fcfc-403d-4489-8a13-90156c5b702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.952418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1272/2554] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:23.963630 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cec85-b0aa-4a4e-ae06-cac5c159c3a4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:23.963882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cec85-b0aa-4a4e-ae06-cac5c159c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:23.964330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cec85-b0aa-4a4e-ae06-cac5c159c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:23.984624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-809cec85-b0aa-4a4e-ae06-cac5c159c3a4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:23.985981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-809cec85-b0aa-4a4e-ae06-cac5c159c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:23.994105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1283/2555] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:43:23.998354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46fcfc-403d-4489-8a13-90156c5b702a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.010681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46fcfc-403d-4489-8a13-90156c5b702a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.017210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.018154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.018524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.018793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.019507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:43:24.019807 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.021386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.033270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1273/2556] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:43:24.037513 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cec85-b0aa-4a4e-ae06-cac5c159c3a4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.047343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cec85-b0aa-4a4e-ae06-cac5c159c3a4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.051984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0931d6-26e8-401f-a7a2-f7182b3113d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.052634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0931d6-26e8-401f-a7a2-f7182b3113d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.052921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0931d6-26e8-401f-a7a2-f7182b3113d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.053201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0931d6-26e8-401f-a7a2-f7182b3113d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.053942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0931d6-26e8-401f-a7a2-f7182b3113d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.055837 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0931d6-26e8-401f-a7a2-f7182b3113d2 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.081605 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1284/2557] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:24 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:24.085633 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.097617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7452a-2dfb-42f8-88cf-af916b2e52df admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.153113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58348d6-7d9c-443d-81ec-5b1e55801f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.153741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58348d6-7d9c-443d-81ec-5b1e55801f5a admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.154593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58348d6-7d9c-443d-81ec-5b1e55801f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.154875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58348d6-7d9c-443d-81ec-5b1e55801f5a admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.155562 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58348d6-7d9c-443d-81ec-5b1e55801f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.157485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58348d6-7d9c-443d-81ec-5b1e55801f5a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.178077 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1274/2558] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:24 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:24.182213 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0931d6-26e8-401f-a7a2-f7182b3113d2 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.192436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0931d6-26e8-401f-a7a2-f7182b3113d2 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.197130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d313f-8a67-46c6-9c3d-ce0ba6acc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.197817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d313f-8a67-46c6-9c3d-ce0ba6acc464 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.198098 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d313f-8a67-46c6-9c3d-ce0ba6acc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.198368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d313f-8a67-46c6-9c3d-ce0ba6acc464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.199140 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d313f-8a67-46c6-9c3d-ce0ba6acc464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.201232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d313f-8a67-46c6-9c3d-ce0ba6acc464 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.211332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1285/2559] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:24.215280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58348d6-7d9c-443d-81ec-5b1e55801f5a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.225752 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58348d6-7d9c-443d-81ec-5b1e55801f5a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.230359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de38440-4e4c-49c7-8d56-5a7b3ac26ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.231015 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38440-4e4c-49c7-8d56-5a7b3ac26ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.231301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38440-4e4c-49c7-8d56-5a7b3ac26ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.231580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38440-4e4c-49c7-8d56-5a7b3ac26ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.232335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de38440-4e4c-49c7-8d56-5a7b3ac26ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.233964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de38440-4e4c-49c7-8d56-5a7b3ac26ff1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.243623 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1275/2560] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:24.247607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d313f-8a67-46c6-9c3d-ce0ba6acc464 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.257094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d313f-8a67-46c6-9c3d-ce0ba6acc464 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.261657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a40916-ecd5-4b0a-9571-19350e1a1f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.262515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40916-ecd5-4b0a-9571-19350e1a1f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.262798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40916-ecd5-4b0a-9571-19350e1a1f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.263074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40916-ecd5-4b0a-9571-19350e1a1f0f admin admin] PATH_INFO: `/v3/projects/12b6a498ae214e3cb9201ca6977a4abd/users/f3c362eaca2f465c862f4787a28cddce/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.277327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a40916-ecd5-4b0a-9571-19350e1a1f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b6a498ae214e3cb9201ca6977a4abd, user_id=f3c362eaca2f465c862f4787a28cddce, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.280663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a40916-ecd5-4b0a-9571-19350e1a1f0f admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.301196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1286/2561] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:24 2022] PUT /identity/v3/projects/12b6a498ae214e3cb9201ca6977a4abd/users/f3c362eaca2f465c862f4787a28cddce/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:24.312038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d9ef-ec56-4ed5-b30e-abf76f62b488 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.312330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d9ef-ec56-4ed5-b30e-abf76f62b488 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.312645 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d9ef-ec56-4ed5-b30e-abf76f62b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.344232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1824d9ef-ec56-4ed5-b30e-abf76f62b488 None None] MFA Rules not processed for user `f3c362eaca2f465c862f4787a28cddce`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:24.345443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1824d9ef-ec56-4ed5-b30e-abf76f62b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:24.406392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1276/2562] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:24.410929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a40916-ecd5-4b0a-9571-19350e1a1f0f admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.470762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a40916-ecd5-4b0a-9571-19350e1a1f0f admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.476296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fb40a-3bbf-40f4-88be-1eb35f0354bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.476945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb40a-3bbf-40f4-88be-1eb35f0354bd admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.477227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb40a-3bbf-40f4-88be-1eb35f0354bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.477501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb40a-3bbf-40f4-88be-1eb35f0354bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.478226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fb40a-3bbf-40f4-88be-1eb35f0354bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.480117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fb40a-3bbf-40f4-88be-1eb35f0354bd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.504472 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1287/2563] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:24 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:24.508507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d9ef-ec56-4ed5-b30e-abf76f62b488 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.519500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d9ef-ec56-4ed5-b30e-abf76f62b488 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.574828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d0ff6-dda5-4048-b164-ca0421be572a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.575485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0ff6-dda5-4048-b164-ca0421be572a admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.576427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0ff6-dda5-4048-b164-ca0421be572a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.576706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d0ff6-dda5-4048-b164-ca0421be572a admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.577389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d0ff6-dda5-4048-b164-ca0421be572a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.579320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d0ff6-dda5-4048-b164-ca0421be572a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.597921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1277/2564] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:24 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:24.602032 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fb40a-3bbf-40f4-88be-1eb35f0354bd admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.611783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fb40a-3bbf-40f4-88be-1eb35f0354bd admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.616454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce55c2-a117-4e1f-ba79-e93e6f632cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.617099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce55c2-a117-4e1f-ba79-e93e6f632cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.617379 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce55c2-a117-4e1f-ba79-e93e6f632cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.617690 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce55c2-a117-4e1f-ba79-e93e6f632cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.618403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce55c2-a117-4e1f-ba79-e93e6f632cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.620013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce55c2-a117-4e1f-ba79-e93e6f632cd8 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.630495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1288/2565] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:24.634726 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d0ff6-dda5-4048-b164-ca0421be572a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.646021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d0ff6-dda5-4048-b164-ca0421be572a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.651380 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.652271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.652666 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.652947 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] PATH_INFO: `/v3/projects/4e8d25cec1ec4f14bdb605298cb72b25/users/556bcd7189b44eac8267589ace8090de/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.672310 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8d25cec1ec4f14bdb605298cb72b25, user_id=556bcd7189b44eac8267589ace8090de, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.676693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.691418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1278/2566] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:24 2022] PUT /identity/v3/projects/4e8d25cec1ec4f14bdb605298cb72b25/users/556bcd7189b44eac8267589ace8090de/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:43:24.695376 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce55c2-a117-4e1f-ba79-e93e6f632cd8 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.706502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce55c2-a117-4e1f-ba79-e93e6f632cd8 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.750193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.751910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:24.760457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72521101-2214-4b5d-b3fb-cc74eccd8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.761185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521101-2214-4b5d-b3fb-cc74eccd8d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.761470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521101-2214-4b5d-b3fb-cc74eccd8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.761774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72521101-2214-4b5d-b3fb-cc74eccd8d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.762495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72521101-2214-4b5d-b3fb-cc74eccd8d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.764779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72521101-2214-4b5d-b3fb-cc74eccd8d48 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.774271 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1289/2567] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:24.778366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72521101-2214-4b5d-b3fb-cc74eccd8d48 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.787638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72521101-2214-4b5d-b3fb-cc74eccd8d48 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.792242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339774f-2e2c-4c3c-a6e4-219dd91d9625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.793149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339774f-2e2c-4c3c-a6e4-219dd91d9625 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.793437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339774f-2e2c-4c3c-a6e4-219dd91d9625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.793744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339774f-2e2c-4c3c-a6e4-219dd91d9625 admin admin] PATH_INFO: `/v3/projects/4e8d25cec1ec4f14bdb605298cb72b25/users/556bcd7189b44eac8267589ace8090de/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.795723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339774f-2e2c-4c3c-a6e4-219dd91d9625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8d25cec1ec4f14bdb605298cb72b25, user_id=556bcd7189b44eac8267589ace8090de, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.798430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339774f-2e2c-4c3c-a6e4-219dd91d9625 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.807166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8912b-2c34-46de-b380-440375fe581e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.808295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1290/2568] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:24 2022] PUT /identity/v3/projects/4e8d25cec1ec4f14bdb605298cb72b25/users/556bcd7189b44eac8267589ace8090de/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:43:24.820032 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfc5c-806a-4ce6-bb39-7dc1479f221f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.820326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfc5c-806a-4ce6-bb39-7dc1479f221f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.820602 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfc5c-806a-4ce6-bb39-7dc1479f221f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.848036 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8a2dfc5c-806a-4ce6-bb39-7dc1479f221f None None] MFA Rules not processed for user `556bcd7189b44eac8267589ace8090de`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:24.849249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8a2dfc5c-806a-4ce6-bb39-7dc1479f221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:24.857605 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.858254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.858535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.858810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:24.860608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:24.916499 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1291/2569] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:43:24.926873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dfc5c-806a-4ce6-bb39-7dc1479f221f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:24.928236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8a2dfc5c-806a-4ce6-bb39-7dc1479f221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:24.929397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:24.930882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:24.941892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1279/2570] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:43:24.984745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dfc5c-806a-4ce6-bb39-7dc1479f221f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:24.988456 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695428a-504e-41e4-8825-874f6aa15eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:24.989065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695428a-504e-41e4-8825-874f6aa15eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:24.989344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695428a-504e-41e4-8825-874f6aa15eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:24.989650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695428a-504e-41e4-8825-874f6aa15eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:25.044587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695428a-504e-41e4-8825-874f6aa15eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:25.046063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695428a-504e-41e4-8825-874f6aa15eb2 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:25.055034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1292/2571] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:43:27.563662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:27.624038 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974def0-5075-49c5-9b3c-f39c4b3ecefa service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:27.628721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:27.629613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:27.629894 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:27.630169 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] PATH_INFO: `/v3/users/f3c362eaca2f465c862f4787a28cddce` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:27.631347 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c362eaca2f465c862f4787a28cddce)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:27.633244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:27.676741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c362eaca2f465c862f4787a28cddce'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:27.688252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c362eaca2f465c862f4787a28cddce'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:27.688915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c362eaca2f465c862f4787a28cddce'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:27.695745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c362eaca2f465c862f4787a28cddce'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:27.696372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c362eaca2f465c862f4787a28cddce'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:27.708943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1280/2572] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:27 2022] DELETE /identity/v3/users/f3c362eaca2f465c862f4787a28cddce => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:27.713453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbedeac-755d-4136-bfc9-791d1081de75 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:27.713987 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbedeac-755d-4136-bfc9-791d1081de75 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:27.714092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbedeac-755d-4136-bfc9-791d1081de75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:27.731342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-cbbedeac-755d-4136-bfc9-791d1081de75 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:27.733160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cbbedeac-755d-4136-bfc9-791d1081de75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:27.789330 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1293/2573] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:27.799559 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:27.800961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:27.857017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ebe3a-b960-41e1-917c-60c686ba7e24 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:27.860604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9810369-fea0-403c-96dc-6722cdf1ab36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:27.861247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9810369-fea0-403c-96dc-6722cdf1ab36 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:27.861553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9810369-fea0-403c-96dc-6722cdf1ab36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:27.861852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9810369-fea0-403c-96dc-6722cdf1ab36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:27.870788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9810369-fea0-403c-96dc-6722cdf1ab36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:27.872212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9810369-fea0-403c-96dc-6722cdf1ab36 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:27.881855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1281/2574] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:28.137371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbedeac-755d-4136-bfc9-791d1081de75 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:28.139325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cbbedeac-755d-4136-bfc9-791d1081de75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:28.150893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbedeac-755d-4136-bfc9-791d1081de75 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:28.156083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:28.156941 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:28.157219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:28.157490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] PATH_INFO: `/v3/projects/12b6a498ae214e3cb9201ca6977a4abd` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:28.158703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b6a498ae214e3cb9201ca6977a4abd)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:28.160607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:28.205633 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b6a498ae214e3cb9201ca6977a4abd', 'request_id': 'req-0ef9ef3f-a11c-4830-a050-db5b603df528'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.210802 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b6a498ae214e3cb9201ca6977a4abd', 'request_id': 'req-0ef9ef3f-a11c-4830-a050-db5b603df528'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.218040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b6a498ae214e3cb9201ca6977a4abd', 'request_id': 'req-0ef9ef3f-a11c-4830-a050-db5b603df528'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.228678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] The token cache is being invalidate because project 12b6a498ae214e3cb9201ca6977a4abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:28.228960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.229601 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.231120 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1294/2575] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:28 2022] DELETE /identity/v3/projects/12b6a498ae214e3cb9201ca6977a4abd => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:28.235166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9810369-fea0-403c-96dc-6722cdf1ab36 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:28.244847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9810369-fea0-403c-96dc-6722cdf1ab36 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:28.299849 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:28.300714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:28.300993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:28.301266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] PATH_INFO: `/v3/users/556bcd7189b44eac8267589ace8090de` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:28.302477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=556bcd7189b44eac8267589ace8090de)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:28.304368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:28.348528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556bcd7189b44eac8267589ace8090de'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.360713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556bcd7189b44eac8267589ace8090de'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.361441 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556bcd7189b44eac8267589ace8090de'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.368410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556bcd7189b44eac8267589ace8090de'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.369220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-29a9b8e6-8101-489f-983d-671242a02ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556bcd7189b44eac8267589ace8090de'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.383532 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1282/2576] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:28 2022] DELETE /identity/v3/users/556bcd7189b44eac8267589ace8090de => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:28.730932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:28.733055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:28.751070 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9ef3f-a11c-4830-a050-db5b603df528 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:28.808176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:28.809073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:28.809326 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:28.809638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] PATH_INFO: `/v3/projects/4e8d25cec1ec4f14bdb605298cb72b25` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:28.811392 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8d25cec1ec4f14bdb605298cb72b25)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:28.813299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:28.858463 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8d25cec1ec4f14bdb605298cb72b25', 'request_id': 'req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.863626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8d25cec1ec4f14bdb605298cb72b25', 'request_id': 'req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.870572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8d25cec1ec4f14bdb605298cb72b25', 'request_id': 'req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.882007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] The token cache is being invalidate because project 4e8d25cec1ec4f14bdb605298cb72b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:28.882290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.882916 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2c91ba28-cbfd-43be-b6a3-ef44d5062a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:28.884464 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1295/2577] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:28 2022] DELETE /identity/v3/projects/4e8d25cec1ec4f14bdb605298cb72b25 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:28.889324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59c72-7d54-4b62-8b64-aa2ed15d93c6 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:28.889863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59c72-7d54-4b62-8b64-aa2ed15d93c6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:28.889962 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f59c72-7d54-4b62-8b64-aa2ed15d93c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:28.907172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-92f59c72-7d54-4b62-8b64-aa2ed15d93c6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:28.908309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-92f59c72-7d54-4b62-8b64-aa2ed15d93c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:28.970840 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1283/2578] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:28.979136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d0874-9745-4ebe-a189-34d16f50965e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:28.979424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d0874-9745-4ebe-a189-34d16f50965e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:28.979703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d0874-9745-4ebe-a189-34d16f50965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:28.998617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-774d0874-9745-4ebe-a189-34d16f50965e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:29.000117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-774d0874-9745-4ebe-a189-34d16f50965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:29.008217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1296/2579] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:43:29.012909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f59c72-7d54-4b62-8b64-aa2ed15d93c6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:29.022232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f59c72-7d54-4b62-8b64-aa2ed15d93c6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:29.027514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:29.028201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:29.028481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:29.029370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:29.030151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:43:29.030456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:29.032041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:29.047473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1284/2580] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:43:29.048389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d0874-9745-4ebe-a189-34d16f50965e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:29.057309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d0874-9745-4ebe-a189-34d16f50965e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:29.061961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811a688-9478-46f5-aa36-7cbf0651910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:29.062715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a688-9478-46f5-aa36-7cbf0651910e admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:29.062999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a688-9478-46f5-aa36-7cbf0651910e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:29.063274 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811a688-9478-46f5-aa36-7cbf0651910e admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:29.063980 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811a688-9478-46f5-aa36-7cbf0651910e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:29.066178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811a688-9478-46f5-aa36-7cbf0651910e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:29.096266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1297/2581] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:43:29 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:43:29.097845 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:29.108067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48176a-3e54-45cf-88a4-ae733908eb98 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:29.162682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93212888-f9db-4464-9edb-277cda529aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:29.163395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93212888-f9db-4464-9edb-277cda529aab admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:29.163683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93212888-f9db-4464-9edb-277cda529aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:29.163963 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93212888-f9db-4464-9edb-277cda529aab admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:29.164671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93212888-f9db-4464-9edb-277cda529aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:29.166970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93212888-f9db-4464-9edb-277cda529aab admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:29.187817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1285/2582] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:43:29 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:43:29.192408 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811a688-9478-46f5-aa36-7cbf0651910e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:29.202506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811a688-9478-46f5-aa36-7cbf0651910e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:29.207074 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20647c5e-d033-4204-b00a-acc12269cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:29.207725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20647c5e-d033-4204-b00a-acc12269cfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:29.208013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20647c5e-d033-4204-b00a-acc12269cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:29.208294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20647c5e-d033-4204-b00a-acc12269cfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:29.209015 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20647c5e-d033-4204-b00a-acc12269cfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:29.210650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20647c5e-d033-4204-b00a-acc12269cfa8 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:29.221490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1298/2583] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:29.225419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93212888-f9db-4464-9edb-277cda529aab admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:29.235920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93212888-f9db-4464-9edb-277cda529aab admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:29.240557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00301f8c-7fec-423a-b649-d14b0833bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:29.241218 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00301f8c-7fec-423a-b649-d14b0833bc23 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:29.241528 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00301f8c-7fec-423a-b649-d14b0833bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:29.241876 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00301f8c-7fec-423a-b649-d14b0833bc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:29.242607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00301f8c-7fec-423a-b649-d14b0833bc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:29.244196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00301f8c-7fec-423a-b649-d14b0833bc23 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:29.254184 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1286/2584] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:43:29.258316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20647c5e-d033-4204-b00a-acc12269cfa8 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:29.268269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20647c5e-d033-4204-b00a-acc12269cfa8 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:29.273065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:29.274012 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:29.274296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:29.274576 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] PATH_INFO: `/v3/projects/afc55feebdd54a038e156888d0c05c05/users/56e4b0cfdc5642c5b84f0f7c6e4bf62e/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:29.290240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc55feebdd54a038e156888d0c05c05, user_id=56e4b0cfdc5642c5b84f0f7c6e4bf62e, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:29.292945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:29.306960 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1299/2585] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:43:29 2022] PUT /identity/v3/projects/afc55feebdd54a038e156888d0c05c05/users/56e4b0cfdc5642c5b84f0f7c6e4bf62e/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:43:29.317309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19783d-6c7b-4738-8a38-e9f163129c71 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:29.317635 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19783d-6c7b-4738-8a38-e9f163129c71 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:29.317925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19783d-6c7b-4738-8a38-e9f163129c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:29.349455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1a19783d-6c7b-4738-8a38-e9f163129c71 None None] MFA Rules not processed for user `56e4b0cfdc5642c5b84f0f7c6e4bf62e`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:29.350902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1a19783d-6c7b-4738-8a38-e9f163129c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:29.416550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1287/2586] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:29.427505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:29.429162 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:29.485829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ca514-4519-4ed6-9920-edc999a96d49 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:29.489667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91feeca74fe749fba52423aa28d48916', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:29.490342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:29.490678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:29.490955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:29.499481 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:29.500936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:29.510127 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1300/2587] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:31.952260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029241c-72b1-452f-ba1c-e6bf48e90766 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:31.952864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029241c-72b1-452f-ba1c-e6bf48e90766 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:31.952864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029241c-72b1-452f-ba1c-e6bf48e90766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:31.973610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7029241c-72b1-452f-ba1c-e6bf48e90766 None None] MFA Rules not processed for user `ed2dae16f03c4eff9185087ed50120fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:31.974774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7029241c-72b1-452f-ba1c-e6bf48e90766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:32.027512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1288/2588] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:32.775683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:32.777199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:32.852198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029241c-72b1-452f-ba1c-e6bf48e90766 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:32.852446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a96b60-69c6-48ed-8a1c-c4f7bb02a4a2 service glance] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:32.853877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7029241c-72b1-452f-ba1c-e6bf48e90766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:32.857298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:32.858006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:32.858291 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:32.858564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:32.860356 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:32.874568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:32.876170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:32.887292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1301/2589] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:32.935283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029241c-72b1-452f-ba1c-e6bf48e90766 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:32.942742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ed514-c39a-4298-8c52-20efafe8f76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:32.943481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed514-c39a-4298-8c52-20efafe8f76d service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:32.943893 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed514-c39a-4298-8c52-20efafe8f76d service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:32.944459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed514-c39a-4298-8c52-20efafe8f76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:32.946119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-958ed514-c39a-4298-8c52-20efafe8f76d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:33.010858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ed514-c39a-4298-8c52-20efafe8f76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:33.012458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ed514-c39a-4298-8c52-20efafe8f76d service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:33.023016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1289/2590] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:43:45.560380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:45.561834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:45.617757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572118e-401b-4b4a-ba1b-51e468c7390c service placement] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:45.621296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:45.621986 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:45.622266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:45.622539 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:45.624380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:45.633975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:45.635536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:45.643411 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1302/2591] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:47.695113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50983d0-a42a-447a-b47a-0837c29959ee None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:47.695674 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50983d0-a42a-447a-b47a-0837c29959ee None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:47.695996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50983d0-a42a-447a-b47a-0837c29959ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:47.713250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c50983d0-a42a-447a-b47a-0837c29959ee None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:47.714457 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c50983d0-a42a-447a-b47a-0837c29959ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:47.769382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1290/2592] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:43:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:47.808484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:47.810519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:47.879055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cbb72-3d89-4564-a450-f4da7fa449e1 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:47.884095 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780cdde-3556-4d90-81c0-1b4438c6432c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:47.884776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cdde-3556-4d90-81c0-1b4438c6432c service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:47.885061 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cdde-3556-4d90-81c0-1b4438c6432c service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:47.885339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cdde-3556-4d90-81c0-1b4438c6432c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:47.894154 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780cdde-3556-4d90-81c0-1b4438c6432c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:47.895926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780cdde-3556-4d90-81c0-1b4438c6432c service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:47.904327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1303/2593] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:43:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:43:50.273926 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50983d0-a42a-447a-b47a-0837c29959ee None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:50.276018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c50983d0-a42a-447a-b47a-0837c29959ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:50.294905 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50983d0-a42a-447a-b47a-0837c29959ee None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:50.301717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091da39-e6c0-4e7f-a4a1-4969fd7b5f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:50.302599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091da39-e6c0-4e7f-a4a1-4969fd7b5f40 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:50.303065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091da39-e6c0-4e7f-a4a1-4969fd7b5f40 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:50.303505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091da39-e6c0-4e7f-a4a1-4969fd7b5f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:50.305480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c091da39-e6c0-4e7f-a4a1-4969fd7b5f40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:50.341874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091da39-e6c0-4e7f-a4a1-4969fd7b5f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:50.343833 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091da39-e6c0-4e7f-a4a1-4969fd7b5f40 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:50.368454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1291/2594] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:43:55.308238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780cdde-3556-4d90-81c0-1b4438c6432c service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:55.390795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780cdde-3556-4d90-81c0-1b4438c6432c service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:55.396171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:55.397317 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:55.397888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:55.398198 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] PATH_INFO: `/v3/users/56e4b0cfdc5642c5b84f0f7c6e4bf62e` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:55.399518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e4b0cfdc5642c5b84f0f7c6e4bf62e)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:55.401692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:55.453721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e4b0cfdc5642c5b84f0f7c6e4bf62e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:55.472281 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e4b0cfdc5642c5b84f0f7c6e4bf62e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:55.479996 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e4b0cfdc5642c5b84f0f7c6e4bf62e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:55.480820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e4b0cfdc5642c5b84f0f7c6e4bf62e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:55.490006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e4b0cfdc5642c5b84f0f7c6e4bf62e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:55.498116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1304/2595] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:43:55 2022] DELETE /identity/v3/users/56e4b0cfdc5642c5b84f0f7c6e4bf62e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:43:55.503198 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73011dab-3e77-494f-99ef-c5fa36f981cb None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:55.503711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73011dab-3e77-494f-99ef-c5fa36f981cb None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:55.503990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73011dab-3e77-494f-99ef-c5fa36f981cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:55.523850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-73011dab-3e77-494f-99ef-c5fa36f981cb None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:43:55.525082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-73011dab-3e77-494f-99ef-c5fa36f981cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:55.592426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1292/2596] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:43:55.603368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:55.605150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:55.679497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1975-8a57-4337-b50a-f34b907fcab5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:55.685385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:55.686136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:55.686490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:55.686835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:55.700702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:55.702229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:55.728766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1305/2597] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:43:56.037669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73011dab-3e77-494f-99ef-c5fa36f981cb None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:43:56.039709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-73011dab-3e77-494f-99ef-c5fa36f981cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:43:56.064591 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73011dab-3e77-494f-99ef-c5fa36f981cb None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:43:56.069990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:43:56.070990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:43:56.071340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:43:56.071684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] PATH_INFO: `/v3/projects/afc55feebdd54a038e156888d0c05c05` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:43:56.074054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc55feebdd54a038e156888d0c05c05)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:43:56.076168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:43:56.131781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc55feebdd54a038e156888d0c05c05', 'request_id': 'req-ea4de32d-fddc-49ca-8ee2-663c71cc108a'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:56.138426 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc55feebdd54a038e156888d0c05c05', 'request_id': 'req-ea4de32d-fddc-49ca-8ee2-663c71cc108a'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:56.146246 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc55feebdd54a038e156888d0c05c05', 'request_id': 'req-ea4de32d-fddc-49ca-8ee2-663c71cc108a'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:56.169374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] The token cache is being invalidate because project afc55feebdd54a038e156888d0c05c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:43:56.174476 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:56.175393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:43:56.178127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1293/2598] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:43:56 2022] DELETE /identity/v3/projects/afc55feebdd54a038e156888d0c05c05 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:00.473519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:00.475267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:00.555273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ea0a2-e5b5-4749-86f4-9e4756e32048 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:00.617225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d614b7-9621-4216-b2e8-29259897ef15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:00.618025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d614b7-9621-4216-b2e8-29259897ef15 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:00.618604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d614b7-9621-4216-b2e8-29259897ef15 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:00.618918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d614b7-9621-4216-b2e8-29259897ef15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:00.620732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-c4d614b7-9621-4216-b2e8-29259897ef15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:00.633232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d614b7-9621-4216-b2e8-29259897ef15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:00.634743 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d614b7-9621-4216-b2e8-29259897ef15 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:00.648030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1306/2599] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:01.294214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:01.295734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:01.351315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de32d-fddc-49ca-8ee2-663c71cc108a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:01.354823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a83075-a922-474e-8512-e0e1f42a357a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:01.356056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83075-a922-474e-8512-e0e1f42a357a service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.356339 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83075-a922-474e-8512-e0e1f42a357a service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.356613 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a83075-a922-474e-8512-e0e1f42a357a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.358350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-72a83075-a922-474e-8512-e0e1f42a357a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:01.367344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a83075-a922-474e-8512-e0e1f42a357a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:01.368756 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a83075-a922-474e-8512-e0e1f42a357a service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:01.376590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1294/2600] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:01.477462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43284-4bb8-4793-90a1-dd6d094d6492 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.478069 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43284-4bb8-4793-90a1-dd6d094d6492 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.478170 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43284-4bb8-4793-90a1-dd6d094d6492 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.484202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1307/2601] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:44:01.487990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daf11-e21b-4bd5-a1b5-94847bb42401 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.488350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daf11-e21b-4bd5-a1b5-94847bb42401 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.488697 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96daf11-e21b-4bd5-a1b5-94847bb42401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.506878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f96daf11-e21b-4bd5-a1b5-94847bb42401 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:01.508071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f96daf11-e21b-4bd5-a1b5-94847bb42401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:01.517235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1295/2602] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:44:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:01.530504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb43284-4bb8-4793-90a1-dd6d094d6492 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:01.532325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-aeb43284-4bb8-4793-90a1-dd6d094d6492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:01.591885 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb43284-4bb8-4793-90a1-dd6d094d6492 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:01.595587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7f69c-0970-40d7-a604-68c4c6c9dc79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91feeca74fe749fba52423aa28d48916', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:01.596232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7f69c-0970-40d7-a604-68c4c6c9dc79 service glance] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.596510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7f69c-0970-40d7-a604-68c4c6c9dc79 service glance] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.596783 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7f69c-0970-40d7-a604-68c4c6c9dc79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.606863 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7f69c-0970-40d7-a604-68c4c6c9dc79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:01.608289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7f69c-0970-40d7-a604-68c4c6c9dc79 service glance] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:01.618494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1308/2603] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:01.682788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f7044-b06a-4f98-9996-77e936b2980c None None] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.683075 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f7044-b06a-4f98-9996-77e936b2980c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.683353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f7044-b06a-4f98-9996-77e936b2980c None None] PATH_INFO: `/` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.684733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1296/2604] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:44:01.689469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1659-2bad-4728-8368-fc7da8295e26 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.689811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1659-2bad-4728-8368-fc7da8295e26 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.690087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d1659-2bad-4728-8368-fc7da8295e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.708214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d58d1659-2bad-4728-8368-fc7da8295e26 None None] MFA Rules not processed for user `66b60e827f404e3891e4f24ca842e5b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:01.709420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d58d1659-2bad-4728-8368-fc7da8295e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:01.716471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1309/2605] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:44:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:01.727928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f7044-b06a-4f98-9996-77e936b2980c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:01.738937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f7044-b06a-4f98-9996-77e936b2980c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:01.742439 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c7772-90b2-4984-a118-48fc82654e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:01.743092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c7772-90b2-4984-a118-48fc82654e50 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.743375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c7772-90b2-4984-a118-48fc82654e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.743649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c7772-90b2-4984-a118-48fc82654e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.750500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c7772-90b2-4984-a118-48fc82654e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:01.751931 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c7772-90b2-4984-a118-48fc82654e50 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:01.759490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1297/2606] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:44:01.844165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367f981-db49-47bd-869b-7f9049ec98d0 None None] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.844381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367f981-db49-47bd-869b-7f9049ec98d0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.844685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367f981-db49-47bd-869b-7f9049ec98d0 None None] PATH_INFO: `/` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.846197 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1310/2607] 10.222.0.36 () {54 vars in 921 bytes} [Wed May 11 07:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 07:44:01.851427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b60a0-64b5-46a1-a89f-b4cf04295531 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.851716 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b60a0-64b5-46a1-a89f-b4cf04295531 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.851990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b60a0-64b5-46a1-a89f-b4cf04295531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.869456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-1b8b60a0-64b5-46a1-a89f-b4cf04295531 None None] MFA Rules not processed for user `d42155dc7b5f42b79943f99952448202`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:01.870661 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1b8b60a0-64b5-46a1-a89f-b4cf04295531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:01.880094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1298/2608] 10.222.0.36 () {58 vars in 1018 bytes} [Wed May 11 07:44:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:01.890679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367f981-db49-47bd-869b-7f9049ec98d0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:01.901287 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367f981-db49-47bd-869b-7f9049ec98d0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:01.905442 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:01.906083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:01.906363 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:01.906636 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:01.916341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:01.917789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:01.928571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1311/2609] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:03.556271 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27a09-4f05-4adc-bb96-cb8834546c88 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:03.556744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27a09-4f05-4adc-bb96-cb8834546c88 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:03.556902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27a09-4f05-4adc-bb96-cb8834546c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:03.575272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f5f27a09-4f05-4adc-bb96-cb8834546c88 None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:03.577118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f5f27a09-4f05-4adc-bb96-cb8834546c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:03.631667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1299/2610] 10.222.0.36 () {58 vars in 1009 bytes} [Wed May 11 07:44:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:03.644134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:03.645494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:03.709810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b1c72-a944-4475-99e5-7ec5cb6623a5 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:03.714635 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949d28d-3ce3-4eb6-8196-4efd923263b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:03.715288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949d28d-3ce3-4eb6-8196-4efd923263b7 service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:03.715594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949d28d-3ce3-4eb6-8196-4efd923263b7 service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:03.715865 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949d28d-3ce3-4eb6-8196-4efd923263b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:03.723526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949d28d-3ce3-4eb6-8196-4efd923263b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:03.725080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949d28d-3ce3-4eb6-8196-4efd923263b7 service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:03.732727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1312/2611] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:44:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 07:44:18.432969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05355c12-a9b7-48d9-8bb9-6e70e5c2e95b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:18.433454 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05355c12-a9b7-48d9-8bb9-6e70e5c2e95b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:18.433593 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05355c12-a9b7-48d9-8bb9-6e70e5c2e95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:18.452324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-05355c12-a9b7-48d9-8bb9-6e70e5c2e95b None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:18.453522 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-05355c12-a9b7-48d9-8bb9-6e70e5c2e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:18.460670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1300/2612] 10.222.0.36 () {58 vars in 967 bytes} [Wed May 11 07:44:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:18.472704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949d28d-3ce3-4eb6-8196-4efd923263b7 service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:18.483145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949d28d-3ce3-4eb6-8196-4efd923263b7 service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:18.488268 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:18.488906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:18.489191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:18.489467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:18.497504 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:18.499596 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:18.507445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1313/2613] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:44:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:44:28.989853 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05355c12-a9b7-48d9-8bb9-6e70e5c2e95b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:28.992952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-05355c12-a9b7-48d9-8bb9-6e70e5c2e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:29.020155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05355c12-a9b7-48d9-8bb9-6e70e5c2e95b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:29.036219 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8a264-6a52-41c4-88fe-ddcec8e91028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:29.036900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8a264-6a52-41c4-88fe-ddcec8e91028 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:29.037178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8a264-6a52-41c4-88fe-ddcec8e91028 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:29.037669 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8a264-6a52-41c4-88fe-ddcec8e91028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:29.048598 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-81c8a264-6a52-41c4-88fe-ddcec8e91028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:29.066277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8a264-6a52-41c4-88fe-ddcec8e91028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:29.068392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8a264-6a52-41c4-88fe-ddcec8e91028 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:29.093534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1301/2614] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:29.464543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:29.466010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:29.522969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e88b8c-5dfc-47e8-9e6f-f440f94cb188 service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:29.527292 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:29.527936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:29.528218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:29.528494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:29.530289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:29.587685 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:29.589130 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:29.598295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1314/2615] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:36.951069 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9adbe1-7593-4481-9ce2-48ed9f51a2d9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:36.952005 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9adbe1-7593-4481-9ce2-48ed9f51a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:36.952114 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9adbe1-7593-4481-9ce2-48ed9f51a2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:36.970325 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7d9adbe1-7593-4481-9ce2-48ed9f51a2d9 None None] MFA Rules not processed for user `044d9c04530347b9a03e9c4c352063bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:36.971508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7d9adbe1-7593-4481-9ce2-48ed9f51a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:36.978802 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1302/2616] 10.222.0.36 () {58 vars in 967 bytes} [Wed May 11 07:44:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:36.990823 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:37.002602 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49a93-a2e1-47f7-a203-42ae5c7031c3 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:37.007771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfcfb9-a5fc-46c9-8502-dd5f26db170b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa4d2cc79404c2c8fbc1ff8868b386a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:37.008362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcfb9-a5fc-46c9-8502-dd5f26db170b service swift] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:37.008725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcfb9-a5fc-46c9-8502-dd5f26db170b service swift] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:37.008910 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcfb9-a5fc-46c9-8502-dd5f26db170b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:37.017613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfcfb9-a5fc-46c9-8502-dd5f26db170b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:37.019190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfcfb9-a5fc-46c9-8502-dd5f26db170b service swift] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:37.027378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1315/2617] 10.222.0.36 () {60 vars in 1384 bytes} [Wed May 11 07:44:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 07:44:44.793179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9adbe1-7593-4481-9ce2-48ed9f51a2d9 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:44.796880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7d9adbe1-7593-4481-9ce2-48ed9f51a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:44.866498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9adbe1-7593-4481-9ce2-48ed9f51a2d9 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:44.871479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:44.872497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:44.872847 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:44.873077 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] PATH_INFO: `/v3/users/bdcfff1647ac4569b96ad948bf991c60` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:44.874399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdcfff1647ac4569b96ad948bf991c60)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:44.876823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:44.924955 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdcfff1647ac4569b96ad948bf991c60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:44.936600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdcfff1647ac4569b96ad948bf991c60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:44.937374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdcfff1647ac4569b96ad948bf991c60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:44.944427 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdcfff1647ac4569b96ad948bf991c60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:44.944993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdcfff1647ac4569b96ad948bf991c60'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:44.957711 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1303/2618] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:44:44 2022] DELETE /identity/v3/users/bdcfff1647ac4569b96ad948bf991c60 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:45.126534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfcfb9-a5fc-46c9-8502-dd5f26db170b service swift] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:45.139430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfcfb9-a5fc-46c9-8502-dd5f26db170b service swift] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:45.201748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:45.202532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:45.202812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:45.203079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] PATH_INFO: `/v3/projects/03e1fa8f24714fc9af8b0947ec51aede` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:45.204251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e1fa8f24714fc9af8b0947ec51aede)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:45.206191 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:45.252660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e1fa8f24714fc9af8b0947ec51aede', 'request_id': 'req-b076381e-2820-49a0-8525-42ea847afcda'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.258370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e1fa8f24714fc9af8b0947ec51aede', 'request_id': 'req-b076381e-2820-49a0-8525-42ea847afcda'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.267352 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e1fa8f24714fc9af8b0947ec51aede', 'request_id': 'req-b076381e-2820-49a0-8525-42ea847afcda'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.278749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] The token cache is being invalidate because project 03e1fa8f24714fc9af8b0947ec51aede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:44:45.279579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.280202 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.281767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1316/2619] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:44:45 2022] DELETE /identity/v3/projects/03e1fa8f24714fc9af8b0947ec51aede => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:45.285800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:45.287225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:45.300368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb538ab-33a0-4472-8f14-1f43f3e5fc9e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:45.356143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:45.356879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:45.357340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:45.357649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] PATH_INFO: `/v3/users/86c9d97749934b15906f403b7e17127f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:45.358912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c9d97749934b15906f403b7e17127f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:45.360860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:45.412386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c9d97749934b15906f403b7e17127f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.424861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c9d97749934b15906f403b7e17127f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.425696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c9d97749934b15906f403b7e17127f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.432191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c9d97749934b15906f403b7e17127f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.432888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c9d97749934b15906f403b7e17127f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.450140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1304/2620] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:44:45 2022] DELETE /identity/v3/users/86c9d97749934b15906f403b7e17127f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:44:45.651711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:45.653161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:45.666540 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076381e-2820-49a0-8525-42ea847afcda admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:45.721833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:45.722631 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:45.722931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:45.723208 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] PATH_INFO: `/v3/projects/2aba240f079841fdb01071e98259eec1` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:45.724377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aba240f079841fdb01071e98259eec1)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:45.726538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:45.772029 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aba240f079841fdb01071e98259eec1', 'request_id': 'req-1e793626-933d-40c7-9f97-8c4739b3a951'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.777898 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aba240f079841fdb01071e98259eec1', 'request_id': 'req-1e793626-933d-40c7-9f97-8c4739b3a951'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.785954 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aba240f079841fdb01071e98259eec1', 'request_id': 'req-1e793626-933d-40c7-9f97-8c4739b3a951'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.796847 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] The token cache is being invalidate because project 2aba240f079841fdb01071e98259eec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:44:45.797133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.797807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:45.799614 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1317/2621] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:44:45 2022] DELETE /identity/v3/projects/2aba240f079841fdb01071e98259eec1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:46.706897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:46.708314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:46.763683 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482471-38cf-4dc2-ab20-3dae580ded6a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:46.808658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:46.809297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:46.809604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:46.809882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:46.812192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:46.871346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:46.873375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:46.882867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1305/2622] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:50.024587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.026531 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:50.041950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e793626-933d-40c7-9f97-8c4739b3a951 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:50.046645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:50.047554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.047840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.048124 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] PATH_INFO: `/v3/users/ad7271d8e9424bb7ad8ce1143fc71de9` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.049306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7271d8e9424bb7ad8ce1143fc71de9)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:50.051289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:50.105371 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7271d8e9424bb7ad8ce1143fc71de9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.118678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7271d8e9424bb7ad8ce1143fc71de9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.126671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7271d8e9424bb7ad8ce1143fc71de9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.127386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7271d8e9424bb7ad8ce1143fc71de9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.134708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bd12d460-eadf-4059-b7b4-a0ff5bdd5ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7271d8e9424bb7ad8ce1143fc71de9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.141251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1318/2623] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:44:50 2022] DELETE /identity/v3/users/ad7271d8e9424bb7ad8ce1143fc71de9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:50.309098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.319558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481bd8-cc78-4410-9c83-795c1e094fc4 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:50.374417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:50.375180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.375462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.375733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] PATH_INFO: `/v3/projects/9750cb9309234cb1b63343050ba700f9` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.376886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9750cb9309234cb1b63343050ba700f9)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:50.378806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:50.421179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9750cb9309234cb1b63343050ba700f9', 'request_id': 'req-e559a52c-ea43-424c-9351-706e26f80d28'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.426290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9750cb9309234cb1b63343050ba700f9', 'request_id': 'req-e559a52c-ea43-424c-9351-706e26f80d28'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.433021 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9750cb9309234cb1b63343050ba700f9', 'request_id': 'req-e559a52c-ea43-424c-9351-706e26f80d28'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.444151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] The token cache is being invalidate because project 9750cb9309234cb1b63343050ba700f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:44:50.444435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.445040 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e559a52c-ea43-424c-9351-706e26f80d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:50.446599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1306/2624] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:44:50 2022] DELETE /identity/v3/projects/9750cb9309234cb1b63343050ba700f9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:50.451723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee996e-7b47-49a2-b09b-87f38d1ed751 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.452041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee996e-7b47-49a2-b09b-87f38d1ed751 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.452341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee996e-7b47-49a2-b09b-87f38d1ed751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.470327 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-19ee996e-7b47-49a2-b09b-87f38d1ed751 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:50.471523 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-19ee996e-7b47-49a2-b09b-87f38d1ed751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:50.528342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1319/2625] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:50.536332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05c82a-ca57-4b52-aa0d-ddf92404c3ce None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.536675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05c82a-ca57-4b52-aa0d-ddf92404c3ce None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.536956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05c82a-ca57-4b52-aa0d-ddf92404c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.555056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-fc05c82a-ca57-4b52-aa0d-ddf92404c3ce None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:50.556235 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-fc05c82a-ca57-4b52-aa0d-ddf92404c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:50.564558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1307/2626] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:44:50.568881 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee996e-7b47-49a2-b09b-87f38d1ed751 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.578322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee996e-7b47-49a2-b09b-87f38d1ed751 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:50.582841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:50.583480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.583771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.584041 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.584759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:44:50.585727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:50.587320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:50.598506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1320/2627] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:44:50.602564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05c82a-ca57-4b52-aa0d-ddf92404c3ce None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.611946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05c82a-ca57-4b52-aa0d-ddf92404c3ce None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:50.616541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c97bb-9b04-4ac4-898a-6a6c1c8c8516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:50.617179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c97bb-9b04-4ac4-898a-6a6c1c8c8516 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.617460 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c97bb-9b04-4ac4-898a-6a6c1c8c8516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.617762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c97bb-9b04-4ac4-898a-6a6c1c8c8516 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.618446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c97bb-9b04-4ac4-898a-6a6c1c8c8516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:50.620316 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c97bb-9b04-4ac4-898a-6a6c1c8c8516 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:50.654514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1308/2628] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:44:50 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:44:50.658510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.668157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b67291-818a-43a0-94a5-edea96bdced4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:50.721862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac4a6-7db1-4718-88f3-d5e7eae9350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:50.722520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac4a6-7db1-4718-88f3-d5e7eae9350f admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.722832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac4a6-7db1-4718-88f3-d5e7eae9350f admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.723107 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac4a6-7db1-4718-88f3-d5e7eae9350f admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.723784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ac4a6-7db1-4718-88f3-d5e7eae9350f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:50.725721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ac4a6-7db1-4718-88f3-d5e7eae9350f admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:50.747391 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1321/2629] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:44:50 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:44:50.748795 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c97bb-9b04-4ac4-898a-6a6c1c8c8516 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.758721 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c97bb-9b04-4ac4-898a-6a6c1c8c8516 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:50.763350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb523a9-3fc2-4c55-9c72-51c1c17997ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:50.764001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb523a9-3fc2-4c55-9c72-51c1c17997ee admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.764288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb523a9-3fc2-4c55-9c72-51c1c17997ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.764565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb523a9-3fc2-4c55-9c72-51c1c17997ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.765283 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb523a9-3fc2-4c55-9c72-51c1c17997ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:50.766920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb523a9-3fc2-4c55-9c72-51c1c17997ee admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:50.777119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1309/2630] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:44:50.781286 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac4a6-7db1-4718-88f3-d5e7eae9350f admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.790932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac4a6-7db1-4718-88f3-d5e7eae9350f admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:50.796125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885fa8a-9ddf-4151-ba06-1de550eb910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:50.796775 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885fa8a-9ddf-4151-ba06-1de550eb910e admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.797058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885fa8a-9ddf-4151-ba06-1de550eb910e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.797336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885fa8a-9ddf-4151-ba06-1de550eb910e admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.798123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885fa8a-9ddf-4151-ba06-1de550eb910e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:50.799703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885fa8a-9ddf-4151-ba06-1de550eb910e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:50.809206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1322/2631] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:44:50.813239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb523a9-3fc2-4c55-9c72-51c1c17997ee admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.823120 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb523a9-3fc2-4c55-9c72-51c1c17997ee admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:50.827857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:50.828719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.829006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.829284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] PATH_INFO: `/v3/projects/c3f28b4427b84f3db1aa6838d608faf2/users/d293965e7f004c44b27e272dc1ab0342/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.843945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f28b4427b84f3db1aa6838d608faf2, user_id=d293965e7f004c44b27e272dc1ab0342, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:50.846603 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:50.859957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1310/2632] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:44:50 2022] PUT /identity/v3/projects/c3f28b4427b84f3db1aa6838d608faf2/users/d293965e7f004c44b27e272dc1ab0342/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:44:50.870754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042d32-d004-460f-9c06-3498a28e9d76 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:50.871048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042d32-d004-460f-9c06-3498a28e9d76 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:50.871333 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd042d32-d004-460f-9c06-3498a28e9d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:50.897207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-cd042d32-d004-460f-9c06-3498a28e9d76 None None] MFA Rules not processed for user `d293965e7f004c44b27e272dc1ab0342`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:50.898439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-cd042d32-d004-460f-9c06-3498a28e9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:50.959421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1323/2633] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:44:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:50.970880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:50.972797 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:51.046300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042660a-d48d-4a1e-b21f-9ca04e085afc admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:51.051712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d146ef-4789-4988-9571-3c9ce055aed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:51.052345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d146ef-4789-4988-9571-3c9ce055aed9 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:51.052629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d146ef-4789-4988-9571-3c9ce055aed9 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:51.052901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d146ef-4789-4988-9571-3c9ce055aed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:51.060523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d146ef-4789-4988-9571-3c9ce055aed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:51.062139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d146ef-4789-4988-9571-3c9ce055aed9 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:51.070881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1311/2634] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:53.722485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042d32-d004-460f-9c06-3498a28e9d76 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:53.781500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd042d32-d004-460f-9c06-3498a28e9d76 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:53.786055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:53.786962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:53.787244 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:53.787519 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] PATH_INFO: `/v3/users/d293965e7f004c44b27e272dc1ab0342` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:53.788708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d293965e7f004c44b27e272dc1ab0342)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:53.790671 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:53.835366 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd293965e7f004c44b27e272dc1ab0342'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:53.846429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd293965e7f004c44b27e272dc1ab0342'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:53.852833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd293965e7f004c44b27e272dc1ab0342'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:53.853484 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd293965e7f004c44b27e272dc1ab0342'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:53.860467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd293965e7f004c44b27e272dc1ab0342'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:53.866232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1324/2635] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:44:53 2022] DELETE /identity/v3/users/d293965e7f004c44b27e272dc1ab0342 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:53.870774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625113-abad-4f53-82dc-67d977212485 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:53.871228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625113-abad-4f53-82dc-67d977212485 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:53.871365 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625113-abad-4f53-82dc-67d977212485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:53.889991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3c625113-abad-4f53-82dc-67d977212485 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:53.891205 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3c625113-abad-4f53-82dc-67d977212485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:53.954709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1312/2636] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:53.961471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:53.963016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:54.021682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5bc0f-8298-4661-a4b0-d96c8c671ccb admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:54.025279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dbe9b-fa56-4dfc-a13c-c825005ff019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:54.025962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dbe9b-fa56-4dfc-a13c-c825005ff019 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.026251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dbe9b-fa56-4dfc-a13c-c825005ff019 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.026524 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dbe9b-fa56-4dfc-a13c-c825005ff019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.035650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dbe9b-fa56-4dfc-a13c-c825005ff019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:54.037117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dbe9b-fa56-4dfc-a13c-c825005ff019 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:54.046988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1325/2637] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:44:54.323955 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c625113-abad-4f53-82dc-67d977212485 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:54.325359 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3c625113-abad-4f53-82dc-67d977212485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:54.337203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c625113-abad-4f53-82dc-67d977212485 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:54.342060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:54.343033 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.343319 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.343589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] PATH_INFO: `/v3/projects/c3f28b4427b84f3db1aa6838d608faf2` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.344804 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f28b4427b84f3db1aa6838d608faf2)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:54.346762 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:54.401334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f28b4427b84f3db1aa6838d608faf2', 'request_id': 'req-a124a2cd-7c1e-49f7-8451-0e9c3252a700'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:54.408082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f28b4427b84f3db1aa6838d608faf2', 'request_id': 'req-a124a2cd-7c1e-49f7-8451-0e9c3252a700'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:54.417370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f28b4427b84f3db1aa6838d608faf2', 'request_id': 'req-a124a2cd-7c1e-49f7-8451-0e9c3252a700'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:54.432571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] The token cache is being invalidate because project c3f28b4427b84f3db1aa6838d608faf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:44:54.432863 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:54.433953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a124a2cd-7c1e-49f7-8451-0e9c3252a700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:44:54.435839 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1313/2638] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:44:54 2022] DELETE /identity/v3/projects/c3f28b4427b84f3db1aa6838d608faf2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:54.441389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa026f1-9561-481b-b620-96c002f4497f None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.441389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa026f1-9561-481b-b620-96c002f4497f None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.441692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa026f1-9561-481b-b620-96c002f4497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.464975 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9aa026f1-9561-481b-b620-96c002f4497f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:54.466704 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9aa026f1-9561-481b-b620-96c002f4497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:54.527591 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1326/2639] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:54.535657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309e68-fd07-4b32-9ac8-29d19af8595c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.535939 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309e68-fd07-4b32-9ac8-29d19af8595c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.536239 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd309e68-fd07-4b32-9ac8-29d19af8595c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.554357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-fd309e68-fd07-4b32-9ac8-29d19af8595c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:54.555597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-fd309e68-fd07-4b32-9ac8-29d19af8595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:54.563512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1314/2640] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:54.567919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa026f1-9561-481b-b620-96c002f4497f None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:54.577380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa026f1-9561-481b-b620-96c002f4497f None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:54.581926 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:54.582580 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.582871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.583146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.583871 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:44:54.584177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:54.585811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:54.597765 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1327/2641] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:44:54.601982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd309e68-fd07-4b32-9ac8-29d19af8595c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:54.612138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd309e68-fd07-4b32-9ac8-29d19af8595c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:54.616880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad8875-707f-4567-88bf-e357afa8720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:54.617548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8875-707f-4567-88bf-e357afa8720e admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.617861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8875-707f-4567-88bf-e357afa8720e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.618135 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8875-707f-4567-88bf-e357afa8720e admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.618837 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad8875-707f-4567-88bf-e357afa8720e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:54.620784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad8875-707f-4567-88bf-e357afa8720e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:54.649567 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1315/2642] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:44:54 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:44:54.652062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:54.664752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9a9e2-5d33-4f86-aae3-d2d439379511 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:54.720405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133e290-8f21-4cce-8e7c-afb90e762b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:54.720984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133e290-8f21-4cce-8e7c-afb90e762b80 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.721263 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133e290-8f21-4cce-8e7c-afb90e762b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.721567 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133e290-8f21-4cce-8e7c-afb90e762b80 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.722254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133e290-8f21-4cce-8e7c-afb90e762b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:54.724160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133e290-8f21-4cce-8e7c-afb90e762b80 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:54.745194 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1328/2643] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:44:54 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:44:54.749084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad8875-707f-4567-88bf-e357afa8720e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:54.759036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad8875-707f-4567-88bf-e357afa8720e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:54.764022 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df83f8-e083-4158-9f91-1bc22754091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:54.764675 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df83f8-e083-4158-9f91-1bc22754091b admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.764952 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df83f8-e083-4158-9f91-1bc22754091b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.765335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df83f8-e083-4158-9f91-1bc22754091b admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.766085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df83f8-e083-4158-9f91-1bc22754091b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:54.767657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df83f8-e083-4158-9f91-1bc22754091b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:54.777303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1316/2644] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:44:54.782248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133e290-8f21-4cce-8e7c-afb90e762b80 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:54.792200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133e290-8f21-4cce-8e7c-afb90e762b80 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:54.797455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dcb49-6141-4b84-9ad2-b87d9fc2784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:54.798193 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dcb49-6141-4b84-9ad2-b87d9fc2784e admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.799342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dcb49-6141-4b84-9ad2-b87d9fc2784e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.799342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dcb49-6141-4b84-9ad2-b87d9fc2784e admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.799556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dcb49-6141-4b84-9ad2-b87d9fc2784e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:54.801051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dcb49-6141-4b84-9ad2-b87d9fc2784e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:54.810935 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1329/2645] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:44:54.815061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df83f8-e083-4158-9f91-1bc22754091b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:54.826254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df83f8-e083-4158-9f91-1bc22754091b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:54.831607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14418cf-9cae-43a1-b2ab-ba5302298e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:54.832693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14418cf-9cae-43a1-b2ab-ba5302298e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.832984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14418cf-9cae-43a1-b2ab-ba5302298e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.833260 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14418cf-9cae-43a1-b2ab-ba5302298e77 admin admin] PATH_INFO: `/v3/projects/de0403e99d574ed4b3e4ed9a0a8b50ac/users/344210874f724a5b8380380a74fbb9e9/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.849349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14418cf-9cae-43a1-b2ab-ba5302298e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0403e99d574ed4b3e4ed9a0a8b50ac, user_id=344210874f724a5b8380380a74fbb9e9, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:54.852084 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14418cf-9cae-43a1-b2ab-ba5302298e77 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:54.865097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1317/2646] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:44:54 2022] PUT /identity/v3/projects/de0403e99d574ed4b3e4ed9a0a8b50ac/users/344210874f724a5b8380380a74fbb9e9/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:54.876669 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26b15-2bf4-4b44-9c2f-10edea625960 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:54.876962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26b15-2bf4-4b44-9c2f-10edea625960 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:54.877236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26b15-2bf4-4b44-9c2f-10edea625960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:54.909981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-d2d26b15-2bf4-4b44-9c2f-10edea625960 None None] MFA Rules not processed for user `344210874f724a5b8380380a74fbb9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:54.911257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-d2d26b15-2bf4-4b44-9c2f-10edea625960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:54.975972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1330/2647] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:44:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:44:54.980336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14418cf-9cae-43a1-b2ab-ba5302298e77 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:55.045098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14418cf-9cae-43a1-b2ab-ba5302298e77 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:55.049933 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544405d9-b9f9-463d-8fff-8973db1fea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:55.050616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544405d9-b9f9-463d-8fff-8973db1fea71 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:55.050902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544405d9-b9f9-463d-8fff-8973db1fea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:55.051182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544405d9-b9f9-463d-8fff-8973db1fea71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:55.051888 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544405d9-b9f9-463d-8fff-8973db1fea71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:55.053850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544405d9-b9f9-463d-8fff-8973db1fea71 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:55.081910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1318/2648] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:44:54 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:44:55.086159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26b15-2bf4-4b44-9c2f-10edea625960 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:55.098173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26b15-2bf4-4b44-9c2f-10edea625960 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:55.163042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757be33-3771-4706-b436-2d4e2d620b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:55.163727 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757be33-3771-4706-b436-2d4e2d620b1b admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:55.164006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757be33-3771-4706-b436-2d4e2d620b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:55.164512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757be33-3771-4706-b436-2d4e2d620b1b admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:55.165234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757be33-3771-4706-b436-2d4e2d620b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:55.167205 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9757be33-3771-4706-b436-2d4e2d620b1b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:55.195721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1331/2649] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:44:55 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:44:55.199358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544405d9-b9f9-463d-8fff-8973db1fea71 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:55.211319 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544405d9-b9f9-463d-8fff-8973db1fea71 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:55.218864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8cb26-814b-4132-a09d-19988f12e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:55.219596 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8cb26-814b-4132-a09d-19988f12e038 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:55.219880 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8cb26-814b-4132-a09d-19988f12e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:55.220154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8cb26-814b-4132-a09d-19988f12e038 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:55.220899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8cb26-814b-4132-a09d-19988f12e038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:55.222553 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8cb26-814b-4132-a09d-19988f12e038 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:55.234363 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1319/2650] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:44:55.238625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757be33-3771-4706-b436-2d4e2d620b1b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:55.249440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9757be33-3771-4706-b436-2d4e2d620b1b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:55.255036 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909b191-fcfc-47c5-85ee-66622a62a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:55.255940 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b191-fcfc-47c5-85ee-66622a62a903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:55.256225 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b191-fcfc-47c5-85ee-66622a62a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:55.256501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909b191-fcfc-47c5-85ee-66622a62a903 admin admin] PATH_INFO: `/v3/projects/0a90b9830d88403ebf089c534de0d1c7/users/4818950f777e4e738ce0d242653adbbe/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:55.274676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909b191-fcfc-47c5-85ee-66622a62a903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a90b9830d88403ebf089c534de0d1c7, user_id=4818950f777e4e738ce0d242653adbbe, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:55.277413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909b191-fcfc-47c5-85ee-66622a62a903 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:55.294174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1332/2651] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:44:55 2022] PUT /identity/v3/projects/0a90b9830d88403ebf089c534de0d1c7/users/4818950f777e4e738ce0d242653adbbe/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:55.297969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8cb26-814b-4132-a09d-19988f12e038 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:55.308226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8cb26-814b-4132-a09d-19988f12e038 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:55.369557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd092c-8548-4d1b-b20a-1c8d5e0caf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:55.370447 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd092c-8548-4d1b-b20a-1c8d5e0caf41 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:55.370761 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd092c-8548-4d1b-b20a-1c8d5e0caf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:55.371088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd092c-8548-4d1b-b20a-1c8d5e0caf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:55.371937 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd092c-8548-4d1b-b20a-1c8d5e0caf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:55.374903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd092c-8548-4d1b-b20a-1c8d5e0caf41 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:55.386501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1320/2652] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:44:55.390915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909b191-fcfc-47c5-85ee-66622a62a903 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:55.401730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909b191-fcfc-47c5-85ee-66622a62a903 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:55.417019 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:55.418247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:55.418662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:55.419034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] PATH_INFO: `/v3/projects/0a90b9830d88403ebf089c534de0d1c7/users/4818950f777e4e738ce0d242653adbbe/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:55.421849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a90b9830d88403ebf089c534de0d1c7, user_id=4818950f777e4e738ce0d242653adbbe, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:55.425089 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:55.437571 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1333/2653] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:44:55 2022] PUT /identity/v3/projects/0a90b9830d88403ebf089c534de0d1c7/users/4818950f777e4e738ce0d242653adbbe/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:44:55.447280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a551-935b-40df-b65e-bbdadeda8214 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:55.448047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a551-935b-40df-b65e-bbdadeda8214 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:55.448535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8a551-935b-40df-b65e-bbdadeda8214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:55.490151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c0c8a551-935b-40df-b65e-bbdadeda8214 None None] MFA Rules not processed for user `4818950f777e4e738ce0d242653adbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:44:55.491479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c0c8a551-935b-40df-b65e-bbdadeda8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:55.562989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1321/2654] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:44:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:44:55.573563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:44:55.576382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:44:55.631645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497c5a-3be7-4215-b0b3-4250fa6719fd admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:44:55.635365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:44:55.636002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:44:55.636281 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:44:55.636550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:44:55.692144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:44:55.693665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:44:55.703206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1334/2655] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:44:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:00.316999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8a551-935b-40df-b65e-bbdadeda8214 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:00.327581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8a551-935b-40df-b65e-bbdadeda8214 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:00.331381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:00.332016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:00.332297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:00.332575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:00.343183 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:00.344681 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:00.354958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1322/2656] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:00.514825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:00.516249 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:00.570962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f45a0-9081-4dd4-888d-1eb42e482de3 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:00.574536 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:00.575173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:00.575451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:00.575778 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:00.578453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:00.645672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:00.647128 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:00.661755 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1335/2657] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:03.549305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:03.550898 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:03.569734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7638b9a-9093-4a12-9537-64302ac150f8 service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:03.574665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:03.580860 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:03.581224 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:03.581511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] PATH_INFO: `/v3/users/c6bb9dabb1fc46dda1fe1906ab248c57` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:03.589959 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bb9dabb1fc46dda1fe1906ab248c57)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:03.592129 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:03.636693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bb9dabb1fc46dda1fe1906ab248c57'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.648914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bb9dabb1fc46dda1fe1906ab248c57'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.649858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bb9dabb1fc46dda1fe1906ab248c57'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.656875 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bb9dabb1fc46dda1fe1906ab248c57'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.657610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-846a2614-ca44-4441-b480-228e32539097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bb9dabb1fc46dda1fe1906ab248c57'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.670575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1323/2658] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:45:03 2022] DELETE /identity/v3/users/c6bb9dabb1fc46dda1fe1906ab248c57 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:03.842346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:03.853153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b52198-5d78-4fa7-9e50-6f3c4694c0f0 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:03.908388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:03.909238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:03.909515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:03.909817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] PATH_INFO: `/v3/projects/075ba180d52b46ad9cd3334520bcfb89` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:03.910973 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075ba180d52b46ad9cd3334520bcfb89)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:03.912846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:03.961034 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075ba180d52b46ad9cd3334520bcfb89', 'request_id': 'req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.966936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075ba180d52b46ad9cd3334520bcfb89', 'request_id': 'req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.974679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075ba180d52b46ad9cd3334520bcfb89', 'request_id': 'req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.986204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] The token cache is being invalidate because project 075ba180d52b46ad9cd3334520bcfb89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:45:03.986496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.987115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0cb22fbd-1f45-4aa2-9bf8-cbe433510460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:03.988729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1336/2659] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:45:03 2022] DELETE /identity/v3/projects/075ba180d52b46ad9cd3334520bcfb89 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:03.993687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b00b-d44c-4749-a105-357854ae5fff None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:03.993981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b00b-d44c-4749-a105-357854ae5fff None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:03.994264 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b00b-d44c-4749-a105-357854ae5fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.012368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7e18b00b-d44c-4749-a105-357854ae5fff None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:04.013497 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7e18b00b-d44c-4749-a105-357854ae5fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:04.069430 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1324/2660] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:04.076833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5c50-05b9-4bcb-b3d3-615e4e34fc50 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.077117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5c50-05b9-4bcb-b3d3-615e4e34fc50 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.077393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a5c50-05b9-4bcb-b3d3-615e4e34fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.095075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a44a5c50-05b9-4bcb-b3d3-615e4e34fc50 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:04.096200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a44a5c50-05b9-4bcb-b3d3-615e4e34fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:04.103993 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1337/2661] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:04.108462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18b00b-d44c-4749-a105-357854ae5fff None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:04.117630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18b00b-d44c-4749-a105-357854ae5fff None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:04.122087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:04.123327 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.123606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.123882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.124602 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:45:04.124910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:04.126511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:04.137499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1325/2662] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:45:04.141710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a5c50-05b9-4bcb-b3d3-615e4e34fc50 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:04.150625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a5c50-05b9-4bcb-b3d3-615e4e34fc50 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:04.155590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63b6ae-aa3e-4bf7-a6c4-b1ce81e93ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:04.156218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63b6ae-aa3e-4bf7-a6c4-b1ce81e93ddf admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.156500 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63b6ae-aa3e-4bf7-a6c4-b1ce81e93ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.156771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63b6ae-aa3e-4bf7-a6c4-b1ce81e93ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.157459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63b6ae-aa3e-4bf7-a6c4-b1ce81e93ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:04.159360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63b6ae-aa3e-4bf7-a6c4-b1ce81e93ddf admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:04.183914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1338/2663] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:45:04 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:45:04.187873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:04.197899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf12eec-44ac-4a3a-8ef5-cdd0538c3458 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:04.251291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133c29-16ff-4c1b-9ce0-3161a558ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:04.251949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133c29-16ff-4c1b-9ce0-3161a558ef8f admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.252232 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133c29-16ff-4c1b-9ce0-3161a558ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.252510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133c29-16ff-4c1b-9ce0-3161a558ef8f admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.253195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a133c29-16ff-4c1b-9ce0-3161a558ef8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:04.255128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a133c29-16ff-4c1b-9ce0-3161a558ef8f admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:04.273741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1326/2664] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:45:04 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:45:04.277803 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63b6ae-aa3e-4bf7-a6c4-b1ce81e93ddf admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:04.288370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63b6ae-aa3e-4bf7-a6c4-b1ce81e93ddf admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:04.293066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a08e1-b1cf-408b-891f-00dcd0523e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:04.293759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a08e1-b1cf-408b-891f-00dcd0523e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.294042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a08e1-b1cf-408b-891f-00dcd0523e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.294316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a08e1-b1cf-408b-891f-00dcd0523e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.295649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a08e1-b1cf-408b-891f-00dcd0523e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:04.297241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a08e1-b1cf-408b-891f-00dcd0523e8c admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:04.307269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1339/2665] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:45:04.311011 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133c29-16ff-4c1b-9ce0-3161a558ef8f admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:04.322379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133c29-16ff-4c1b-9ce0-3161a558ef8f admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:04.327335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47d4f7-ba48-4aef-a57a-d808ed5f2b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:04.327992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47d4f7-ba48-4aef-a57a-d808ed5f2b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.328298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47d4f7-ba48-4aef-a57a-d808ed5f2b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.328585 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47d4f7-ba48-4aef-a57a-d808ed5f2b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.329519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47d4f7-ba48-4aef-a57a-d808ed5f2b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:04.331142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47d4f7-ba48-4aef-a57a-d808ed5f2b8a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:04.342214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1327/2666] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:45:04.347125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a08e1-b1cf-408b-891f-00dcd0523e8c admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:04.356887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a08e1-b1cf-408b-891f-00dcd0523e8c admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:04.362235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:04.363113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.363429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.363705 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] PATH_INFO: `/v3/projects/bbefc9c91dab46baa2707f01c83e48e2/users/cb737cfd514343dfbfbc30816cf5f655/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.377876 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbefc9c91dab46baa2707f01c83e48e2, user_id=cb737cfd514343dfbfbc30816cf5f655, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:04.380515 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:04.393403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1340/2667] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:45:04 2022] PUT /identity/v3/projects/bbefc9c91dab46baa2707f01c83e48e2/users/cb737cfd514343dfbfbc30816cf5f655/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:45:04.398438 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba388-861a-4014-887e-c232d4f9343f None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.398730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba388-861a-4014-887e-c232d4f9343f None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.399006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba388-861a-4014-887e-c232d4f9343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.416411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0e7ba388-861a-4014-887e-c232d4f9343f None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:04.417632 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0e7ba388-861a-4014-887e-c232d4f9343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:04.476308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1328/2668] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:45:04.486529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:04.488246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:04.542440 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf0257-f933-45ae-8a2e-e0e1db3e94d1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:04.546094 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:04.546759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:04.547065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:04.547342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:04.556171 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:04.557627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:04.567016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1341/2669] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:08.522297 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec341f8f-2480-497c-be75-33821eb17b8e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:08.522829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec341f8f-2480-497c-be75-33821eb17b8e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:08.522936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec341f8f-2480-497c-be75-33821eb17b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:08.560065 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ec341f8f-2480-497c-be75-33821eb17b8e None None] MFA Rules not processed for user `cb737cfd514343dfbfbc30816cf5f655`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:08.562204 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ec341f8f-2480-497c-be75-33821eb17b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:08.640536 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1329/2670] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:08.654624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:08.656134 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:08.735653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758989a2-a821-4db1-b886-c1ad36cd8fff service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:08.741109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:08.741797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:08.742078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:08.742353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:08.751294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:08.752900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:08.762189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1342/2671] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:10.115691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712401-ffb6-4630-9674-037076213036 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:10.116203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712401-ffb6-4630-9674-037076213036 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:10.116308 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712401-ffb6-4630-9674-037076213036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:10.133662 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-14712401-ffb6-4630-9674-037076213036 None None] MFA Rules not processed for user `cb737cfd514343dfbfbc30816cf5f655`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:10.134842 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-14712401-ffb6-4630-9674-037076213036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:10.142305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1330/2672] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:23.135485 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:23.136899 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:23.151897 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c3c00-1e8c-486d-9571-29a469c85151 service nova] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:23.156365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:23.157250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:23.157528 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:23.157824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] PATH_INFO: `/v3/users/344210874f724a5b8380380a74fbb9e9` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:23.158988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344210874f724a5b8380380a74fbb9e9)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:23.160890 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:23.208695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344210874f724a5b8380380a74fbb9e9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.220853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344210874f724a5b8380380a74fbb9e9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.227645 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344210874f724a5b8380380a74fbb9e9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.228370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344210874f724a5b8380380a74fbb9e9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.236548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344210874f724a5b8380380a74fbb9e9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.242657 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1343/2673] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:45:23 2022] DELETE /identity/v3/users/344210874f724a5b8380380a74fbb9e9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:23.247874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1d211-7d74-4fc1-9634-b39ce8bdaa5e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:23.248344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1d211-7d74-4fc1-9634-b39ce8bdaa5e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:23.248437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1d211-7d74-4fc1-9634-b39ce8bdaa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:23.266282 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0fb1d211-7d74-4fc1-9634-b39ce8bdaa5e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:23.267544 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0fb1d211-7d74-4fc1-9634-b39ce8bdaa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:23.329701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1331/2674] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:23.345353 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:23.346955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:23.406079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b230e-9502-46a7-bc95-8e1aced69b93 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:23.409789 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9a907-6049-4413-9998-9f66312c6c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:23.410430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9a907-6049-4413-9998-9f66312c6c00 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:23.410710 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9a907-6049-4413-9998-9f66312c6c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:23.410983 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9a907-6049-4413-9998-9f66312c6c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:23.421159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9a907-6049-4413-9998-9f66312c6c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:23.422686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9a907-6049-4413-9998-9f66312c6c00 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:23.432294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1344/2675] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:23.829693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1d211-7d74-4fc1-9634-b39ce8bdaa5e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:23.831121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0fb1d211-7d74-4fc1-9634-b39ce8bdaa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:23.843358 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1d211-7d74-4fc1-9634-b39ce8bdaa5e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:23.848013 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:23.848879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:23.849164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:23.849445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] PATH_INFO: `/v3/projects/de0403e99d574ed4b3e4ed9a0a8b50ac` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:23.850668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0403e99d574ed4b3e4ed9a0a8b50ac)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:23.852589 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:23.897140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0403e99d574ed4b3e4ed9a0a8b50ac', 'request_id': 'req-f3ac5672-5e3e-4327-af10-8020f360ecdf'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.902301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0403e99d574ed4b3e4ed9a0a8b50ac', 'request_id': 'req-f3ac5672-5e3e-4327-af10-8020f360ecdf'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.909606 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0403e99d574ed4b3e4ed9a0a8b50ac', 'request_id': 'req-f3ac5672-5e3e-4327-af10-8020f360ecdf'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.920869 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] The token cache is being invalidate because project de0403e99d574ed4b3e4ed9a0a8b50ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:45:23.921155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.921832 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:23.923350 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1332/2676] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:45:23 2022] DELETE /identity/v3/projects/de0403e99d574ed4b3e4ed9a0a8b50ac => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:23.927261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9a907-6049-4413-9998-9f66312c6c00 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:23.936552 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9a907-6049-4413-9998-9f66312c6c00 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:23.994166 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:23.995033 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:23.995308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:23.995578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] PATH_INFO: `/v3/users/4818950f777e4e738ce0d242653adbbe` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:23.996738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4818950f777e4e738ce0d242653adbbe)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:23.998708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:24.042410 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4818950f777e4e738ce0d242653adbbe'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.053386 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4818950f777e4e738ce0d242653adbbe'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.059810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4818950f777e4e738ce0d242653adbbe'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.060450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4818950f777e4e738ce0d242653adbbe'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.067830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-46834f7d-209d-4f09-8f3a-56ea2d110ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4818950f777e4e738ce0d242653adbbe'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.073923 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1345/2677] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:45:23 2022] DELETE /identity/v3/users/4818950f777e4e738ce0d242653adbbe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:24.335734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:24.337225 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:24.351437 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac5672-5e3e-4327-af10-8020f360ecdf admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:24.406728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:24.407587 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.407871 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.408146 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] PATH_INFO: `/v3/projects/0a90b9830d88403ebf089c534de0d1c7` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.409309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a90b9830d88403ebf089c534de0d1c7)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:24.411247 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:24.456649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a90b9830d88403ebf089c534de0d1c7', 'request_id': 'req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.461910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a90b9830d88403ebf089c534de0d1c7', 'request_id': 'req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.469004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a90b9830d88403ebf089c534de0d1c7', 'request_id': 'req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.479693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] The token cache is being invalidate because project 0a90b9830d88403ebf089c534de0d1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:45:24.479977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.480611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-93d5651c-c1e7-42fb-9efd-d34bbb9c0fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:24.482194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1333/2678] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:45:24 2022] DELETE /identity/v3/projects/0a90b9830d88403ebf089c534de0d1c7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:24.487001 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581d61-78a2-4726-afa1-54152920e6ad None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.487410 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581d61-78a2-4726-afa1-54152920e6ad None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.487558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581d61-78a2-4726-afa1-54152920e6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.506754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-a7581d61-78a2-4726-afa1-54152920e6ad None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:24.507947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-a7581d61-78a2-4726-afa1-54152920e6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:24.564430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1346/2679] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:24.572414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15cac8-cb34-4405-9354-e342da9af424 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.572713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15cac8-cb34-4405-9354-e342da9af424 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.573004 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15cac8-cb34-4405-9354-e342da9af424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.591335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-2d15cac8-cb34-4405-9354-e342da9af424 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:24.592537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2d15cac8-cb34-4405-9354-e342da9af424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:24.600413 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1334/2680] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:24.604455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7581d61-78a2-4726-afa1-54152920e6ad None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:24.614199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7581d61-78a2-4726-afa1-54152920e6ad None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:24.618962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:24.619617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.619903 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.620181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.620905 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:45:24.621214 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:24.623450 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:24.634971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1347/2681] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:45:24.639945 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15cac8-cb34-4405-9354-e342da9af424 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:24.649293 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15cac8-cb34-4405-9354-e342da9af424 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:24.654123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552a8d8-15ed-4da6-b407-a03f9eb436d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:24.654800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552a8d8-15ed-4da6-b407-a03f9eb436d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.655080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552a8d8-15ed-4da6-b407-a03f9eb436d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.655363 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552a8d8-15ed-4da6-b407-a03f9eb436d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.656043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552a8d8-15ed-4da6-b407-a03f9eb436d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:24.657974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552a8d8-15ed-4da6-b407-a03f9eb436d5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:24.685338 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1335/2682] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:45:24 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:45:24.689473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:24.699655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b3478-487d-457c-a207-2fb7392b82e1 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:24.754550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b65b7-6e89-4a5a-8075-54ec13d1c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:24.755138 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b65b7-6e89-4a5a-8075-54ec13d1c24a admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.755423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b65b7-6e89-4a5a-8075-54ec13d1c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.755695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b65b7-6e89-4a5a-8075-54ec13d1c24a admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.756368 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b65b7-6e89-4a5a-8075-54ec13d1c24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:24.758299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b65b7-6e89-4a5a-8075-54ec13d1c24a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:24.776449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1348/2683] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:45:24 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:45:24.780571 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552a8d8-15ed-4da6-b407-a03f9eb436d5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:24.790622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552a8d8-15ed-4da6-b407-a03f9eb436d5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:24.795694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a779e04-eb5e-4511-a046-ee76428bde83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:24.796349 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a779e04-eb5e-4511-a046-ee76428bde83 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.796636 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a779e04-eb5e-4511-a046-ee76428bde83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.796920 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a779e04-eb5e-4511-a046-ee76428bde83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.797684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a779e04-eb5e-4511-a046-ee76428bde83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:24.800100 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a779e04-eb5e-4511-a046-ee76428bde83 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:24.812315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1336/2684] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:45:24.816514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b65b7-6e89-4a5a-8075-54ec13d1c24a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:24.826683 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b65b7-6e89-4a5a-8075-54ec13d1c24a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:24.831235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd5816-c04d-4df3-8a8a-3086d7d76b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:24.831888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd5816-c04d-4df3-8a8a-3086d7d76b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.832169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd5816-c04d-4df3-8a8a-3086d7d76b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.832443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd5816-c04d-4df3-8a8a-3086d7d76b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.833190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd5816-c04d-4df3-8a8a-3086d7d76b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:24.834817 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd5816-c04d-4df3-8a8a-3086d7d76b91 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:24.844733 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1349/2685] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:45:24.848816 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a779e04-eb5e-4511-a046-ee76428bde83 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:24.859255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a779e04-eb5e-4511-a046-ee76428bde83 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:24.863831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdfca6-6edd-4e92-99a4-6fab1d1c2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:24.865362 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdfca6-6edd-4e92-99a4-6fab1d1c2fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.865678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdfca6-6edd-4e92-99a4-6fab1d1c2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.865956 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdfca6-6edd-4e92-99a4-6fab1d1c2fd0 admin admin] PATH_INFO: `/v3/projects/ad6948a7f87f4499834864a99cf19d89/users/c1782318e7c74ef0938f377e0b736098/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.881078 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdfca6-6edd-4e92-99a4-6fab1d1c2fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6948a7f87f4499834864a99cf19d89, user_id=c1782318e7c74ef0938f377e0b736098, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:24.883774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdfca6-6edd-4e92-99a4-6fab1d1c2fd0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:24.896949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1337/2686] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:45:24 2022] PUT /identity/v3/projects/ad6948a7f87f4499834864a99cf19d89/users/c1782318e7c74ef0938f377e0b736098/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:24.908273 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614cf8d-41f5-4dda-b95d-1748b684ec87 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:24.908563 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614cf8d-41f5-4dda-b95d-1748b684ec87 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:24.908840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614cf8d-41f5-4dda-b95d-1748b684ec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:24.936378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0614cf8d-41f5-4dda-b95d-1748b684ec87 None None] MFA Rules not processed for user `c1782318e7c74ef0938f377e0b736098`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:24.937616 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0614cf8d-41f5-4dda-b95d-1748b684ec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:25.003030 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1350/2687] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:25.007654 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdfca6-6edd-4e92-99a4-6fab1d1c2fd0 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:25.069024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdfca6-6edd-4e92-99a4-6fab1d1c2fd0 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:25.073736 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eb3e9-7369-4c90-b31e-6e309b5d7d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:25.074398 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb3e9-7369-4c90-b31e-6e309b5d7d85 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.074688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb3e9-7369-4c90-b31e-6e309b5d7d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.075006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb3e9-7369-4c90-b31e-6e309b5d7d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.075719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9eb3e9-7369-4c90-b31e-6e309b5d7d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:25.077936 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9eb3e9-7369-4c90-b31e-6e309b5d7d85 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:25.104970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1338/2688] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:45:25 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:45:25.109123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614cf8d-41f5-4dda-b95d-1748b684ec87 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:25.120031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614cf8d-41f5-4dda-b95d-1748b684ec87 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:25.176587 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b63c8-0fd8-40d0-8a4f-10af73dc9003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:25.177245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b63c8-0fd8-40d0-8a4f-10af73dc9003 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.177526 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b63c8-0fd8-40d0-8a4f-10af73dc9003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.177826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b63c8-0fd8-40d0-8a4f-10af73dc9003 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.178509 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b63c8-0fd8-40d0-8a4f-10af73dc9003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:25.180430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b63c8-0fd8-40d0-8a4f-10af73dc9003 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:25.199827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1351/2689] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:45:25 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:45:25.203749 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eb3e9-7369-4c90-b31e-6e309b5d7d85 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:25.213925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eb3e9-7369-4c90-b31e-6e309b5d7d85 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:25.219435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78746a34-cc56-4dcf-8d46-8076acff83bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:25.220111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78746a34-cc56-4dcf-8d46-8076acff83bc admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.220389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78746a34-cc56-4dcf-8d46-8076acff83bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.220678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78746a34-cc56-4dcf-8d46-8076acff83bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.221397 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78746a34-cc56-4dcf-8d46-8076acff83bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:25.223048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78746a34-cc56-4dcf-8d46-8076acff83bc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:25.234561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1339/2690] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:45:25.238709 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b63c8-0fd8-40d0-8a4f-10af73dc9003 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:25.248810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b63c8-0fd8-40d0-8a4f-10af73dc9003 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:25.253584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24abe3-f7c0-4b18-ad0b-4216a3218ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:25.254478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24abe3-f7c0-4b18-ad0b-4216a3218ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.254744 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24abe3-f7c0-4b18-ad0b-4216a3218ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.255016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24abe3-f7c0-4b18-ad0b-4216a3218ac3 admin admin] PATH_INFO: `/v3/projects/067a35447c6640a09358012646370412/users/a559bd8624844a6ab8b4497e84671b57/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.269449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24abe3-f7c0-4b18-ad0b-4216a3218ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067a35447c6640a09358012646370412, user_id=a559bd8624844a6ab8b4497e84671b57, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:25.272050 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24abe3-f7c0-4b18-ad0b-4216a3218ac3 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:25.285508 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1352/2691] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:45:25 2022] PUT /identity/v3/projects/067a35447c6640a09358012646370412/users/a559bd8624844a6ab8b4497e84671b57/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:45:25.289642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78746a34-cc56-4dcf-8d46-8076acff83bc admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:25.300868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78746a34-cc56-4dcf-8d46-8076acff83bc admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:25.358915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a081ca8-a4c2-4c7b-b0cd-1d890affbeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:25.359616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a081ca8-a4c2-4c7b-b0cd-1d890affbeaf admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.359873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a081ca8-a4c2-4c7b-b0cd-1d890affbeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.360154 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a081ca8-a4c2-4c7b-b0cd-1d890affbeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.360889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a081ca8-a4c2-4c7b-b0cd-1d890affbeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:25.362575 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a081ca8-a4c2-4c7b-b0cd-1d890affbeaf admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:25.373477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1340/2692] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:45:25.378048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24abe3-f7c0-4b18-ad0b-4216a3218ac3 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:25.389078 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24abe3-f7c0-4b18-ad0b-4216a3218ac3 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:25.393902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:25.394825 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.395109 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.395385 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] PATH_INFO: `/v3/projects/067a35447c6640a09358012646370412/users/a559bd8624844a6ab8b4497e84671b57/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.397438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067a35447c6640a09358012646370412, user_id=a559bd8624844a6ab8b4497e84671b57, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:25.400150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:25.411400 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1353/2693] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:45:25 2022] PUT /identity/v3/projects/067a35447c6640a09358012646370412/users/a559bd8624844a6ab8b4497e84671b57/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:25.422300 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829d72-0397-490d-93c1-010d03fd8211 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.422594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829d72-0397-490d-93c1-010d03fd8211 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.422877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829d72-0397-490d-93c1-010d03fd8211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.450758 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c5829d72-0397-490d-93c1-010d03fd8211 None None] MFA Rules not processed for user `a559bd8624844a6ab8b4497e84671b57`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:25.451978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c5829d72-0397-490d-93c1-010d03fd8211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:25.521827 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1341/2694] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:25.533056 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:25.534784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:25.591487 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c7923-0b30-4800-b26f-4db806c50623 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:25.595052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4a228-fd0f-42b2-966a-91d78d54cf6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:25.595676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a228-fd0f-42b2-966a-91d78d54cf6b service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.595952 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a228-fd0f-42b2-966a-91d78d54cf6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.596222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a228-fd0f-42b2-966a-91d78d54cf6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.604827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4a228-fd0f-42b2-966a-91d78d54cf6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:25.606269 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4a228-fd0f-42b2-966a-91d78d54cf6b service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:25.615228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1354/2695] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:25.685611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5829d72-0397-490d-93c1-010d03fd8211 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:25.695354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5829d72-0397-490d-93c1-010d03fd8211 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:25.698921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc4f91-20e6-4cd7-9a47-efc14b31ab58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:25.699554 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc4f91-20e6-4cd7-9a47-efc14b31ab58 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:25.700322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc4f91-20e6-4cd7-9a47-efc14b31ab58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:25.700603 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc4f91-20e6-4cd7-9a47-efc14b31ab58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:25.753851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc4f91-20e6-4cd7-9a47-efc14b31ab58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:25.755324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc4f91-20e6-4cd7-9a47-efc14b31ab58 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:25.764641 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1342/2696] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:45:26.014246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4a228-fd0f-42b2-966a-91d78d54cf6b service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:26.076542 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4a228-fd0f-42b2-966a-91d78d54cf6b service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:26.081355 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:26.082248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:26.082533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:26.082813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] PATH_INFO: `/v3/users/c1782318e7c74ef0938f377e0b736098` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:26.084008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1782318e7c74ef0938f377e0b736098)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:26.085971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:26.138207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1782318e7c74ef0938f377e0b736098'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.149791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1782318e7c74ef0938f377e0b736098'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.156103 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1782318e7c74ef0938f377e0b736098'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.156824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1782318e7c74ef0938f377e0b736098'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.165770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1782318e7c74ef0938f377e0b736098'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.172181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1355/2697] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:45:26 2022] DELETE /identity/v3/users/c1782318e7c74ef0938f377e0b736098 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:26.176855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3aff5-954a-4593-a353-deb77d4389d0 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:26.177144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3aff5-954a-4593-a353-deb77d4389d0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:26.177419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3aff5-954a-4593-a353-deb77d4389d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:26.194780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0bc3aff5-954a-4593-a353-deb77d4389d0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:26.195979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0bc3aff5-954a-4593-a353-deb77d4389d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:26.254938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1343/2698] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:45:26.264395 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:26.265809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:26.321378 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9dead-f7b9-43ba-a3a8-e549c0835d8b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:26.324968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fa82e-4bc0-4ed0-ab66-924fec8c8f1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:26.325638 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fa82e-4bc0-4ed0-ab66-924fec8c8f1a service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:26.325919 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fa82e-4bc0-4ed0-ab66-924fec8c8f1a service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:26.326190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fa82e-4bc0-4ed0-ab66-924fec8c8f1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:26.335377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fa82e-4bc0-4ed0-ab66-924fec8c8f1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:26.336803 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fa82e-4bc0-4ed0-ab66-924fec8c8f1a service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:26.346227 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1356/2699] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:26.764387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3aff5-954a-4593-a353-deb77d4389d0 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:26.765811 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0bc3aff5-954a-4593-a353-deb77d4389d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:26.777249 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3aff5-954a-4593-a353-deb77d4389d0 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:26.782507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:26.783395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:26.783679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:26.783957 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] PATH_INFO: `/v3/projects/ad6948a7f87f4499834864a99cf19d89` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:26.785136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6948a7f87f4499834864a99cf19d89)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:26.787138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:26.837334 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6948a7f87f4499834864a99cf19d89', 'request_id': 'req-982e4ccc-f44b-40e8-b949-88d358e78129'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.843117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6948a7f87f4499834864a99cf19d89', 'request_id': 'req-982e4ccc-f44b-40e8-b949-88d358e78129'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.850312 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6948a7f87f4499834864a99cf19d89', 'request_id': 'req-982e4ccc-f44b-40e8-b949-88d358e78129'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.862320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] The token cache is being invalidate because project ad6948a7f87f4499834864a99cf19d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:45:26.862814 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.863456 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:26.865012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1344/2700] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:45:26 2022] DELETE /identity/v3/projects/ad6948a7f87f4499834864a99cf19d89 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:26.869183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fa82e-4bc0-4ed0-ab66-924fec8c8f1a service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:26.878637 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fa82e-4bc0-4ed0-ab66-924fec8c8f1a service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:26.940110 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:26.941300 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:26.941610 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:26.941947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] PATH_INFO: `/v3/users/a559bd8624844a6ab8b4497e84671b57` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:26.943346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a559bd8624844a6ab8b4497e84671b57)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:26.945139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:26.991521 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a559bd8624844a6ab8b4497e84671b57'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.002934 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a559bd8624844a6ab8b4497e84671b57'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.009455 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a559bd8624844a6ab8b4497e84671b57'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.010242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a559bd8624844a6ab8b4497e84671b57'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.018886 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-33487935-03ef-4062-b1e2-daf136b6f258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a559bd8624844a6ab8b4497e84671b57'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.024644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1357/2701] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:45:26 2022] DELETE /identity/v3/users/a559bd8624844a6ab8b4497e84671b57 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:27.428625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:27.430446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:27.452744 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e4ccc-f44b-40e8-b949-88d358e78129 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:27.514172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:27.515150 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:27.515531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:27.515870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] PATH_INFO: `/v3/projects/067a35447c6640a09358012646370412` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:27.517186 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=067a35447c6640a09358012646370412)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:27.519215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:27.571400 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067a35447c6640a09358012646370412', 'request_id': 'req-d09d6dac-0f3c-443b-b419-6cc8f66913ec'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.577369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067a35447c6640a09358012646370412', 'request_id': 'req-d09d6dac-0f3c-443b-b419-6cc8f66913ec'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.586788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067a35447c6640a09358012646370412', 'request_id': 'req-d09d6dac-0f3c-443b-b419-6cc8f66913ec'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.601934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] The token cache is being invalidate because project 067a35447c6640a09358012646370412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:45:27.602317 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.603139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-d09d6dac-0f3c-443b-b419-6cc8f66913ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:27.604796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1345/2702] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:45:27 2022] DELETE /identity/v3/projects/067a35447c6640a09358012646370412 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:27.610431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8034155-f55b-4913-b66f-c80c9ff39223 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:27.610875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8034155-f55b-4913-b66f-c80c9ff39223 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:27.611272 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8034155-f55b-4913-b66f-c80c9ff39223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:27.633251 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f8034155-f55b-4913-b66f-c80c9ff39223 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:27.634503 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f8034155-f55b-4913-b66f-c80c9ff39223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:27.698746 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1358/2703] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:45:27.708366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919835ea-7916-46c0-88ab-001077a18cf0 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:27.708788 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919835ea-7916-46c0-88ab-001077a18cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:27.709144 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919835ea-7916-46c0-88ab-001077a18cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:27.728412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-919835ea-7916-46c0-88ab-001077a18cf0 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:27.729657 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-919835ea-7916-46c0-88ab-001077a18cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:27.738911 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1346/2704] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:27.743165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8034155-f55b-4913-b66f-c80c9ff39223 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:27.752717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8034155-f55b-4913-b66f-c80c9ff39223 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:27.757995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:27.758731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:27.759079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:27.759730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:27.760341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:45:27.760721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:27.763023 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:27.774991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1359/2705] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:45:27.780199 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919835ea-7916-46c0-88ab-001077a18cf0 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:27.789361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919835ea-7916-46c0-88ab-001077a18cf0 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:27.794097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37022a7-8d29-4b31-8cc1-7c979bc33da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:27.794831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37022a7-8d29-4b31-8cc1-7c979bc33da9 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:27.795178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37022a7-8d29-4b31-8cc1-7c979bc33da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:27.795537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37022a7-8d29-4b31-8cc1-7c979bc33da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:27.796296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37022a7-8d29-4b31-8cc1-7c979bc33da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:27.798298 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37022a7-8d29-4b31-8cc1-7c979bc33da9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:27.827095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1347/2706] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:45:27 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:45:27.831259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:27.842436 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012e45b-6442-4353-89de-5d62201a6412 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:27.903887 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73916-5cec-42ec-a383-4ec7ad9b6f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:27.904984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73916-5cec-42ec-a383-4ec7ad9b6f38 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:27.905431 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73916-5cec-42ec-a383-4ec7ad9b6f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:27.905888 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73916-5cec-42ec-a383-4ec7ad9b6f38 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:27.906961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73916-5cec-42ec-a383-4ec7ad9b6f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:27.909250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73916-5cec-42ec-a383-4ec7ad9b6f38 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:27.935279 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1360/2707] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:45:27 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:45:27.939268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37022a7-8d29-4b31-8cc1-7c979bc33da9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:27.951045 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37022a7-8d29-4b31-8cc1-7c979bc33da9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:27.958207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e331b7-7296-459f-90f3-4bc03a532da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:27.959047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e331b7-7296-459f-90f3-4bc03a532da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:27.959495 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e331b7-7296-459f-90f3-4bc03a532da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:27.959993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e331b7-7296-459f-90f3-4bc03a532da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:27.961170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e331b7-7296-459f-90f3-4bc03a532da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:27.967179 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e331b7-7296-459f-90f3-4bc03a532da3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:27.985626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1348/2708] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:45:27.985867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73916-5cec-42ec-a383-4ec7ad9b6f38 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:27.995995 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73916-5cec-42ec-a383-4ec7ad9b6f38 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:28.002350 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c08ac-ca0c-424a-8ee8-19ff9580b534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:28.003161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c08ac-ca0c-424a-8ee8-19ff9580b534 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:28.003721 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c08ac-ca0c-424a-8ee8-19ff9580b534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:28.004049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c08ac-ca0c-424a-8ee8-19ff9580b534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:28.004961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c08ac-ca0c-424a-8ee8-19ff9580b534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:28.007421 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c08ac-ca0c-424a-8ee8-19ff9580b534 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:28.017581 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1361/2709] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:45:28.021671 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e331b7-7296-459f-90f3-4bc03a532da3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:28.032487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e331b7-7296-459f-90f3-4bc03a532da3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:28.037611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:28.038518 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:28.038954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:28.039241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] PATH_INFO: `/v3/projects/5bf1a0573fdd4ca1a81512a2eda5ec68/users/a71fb581019a498e83d42ac3032c9725/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:28.057147 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf1a0573fdd4ca1a81512a2eda5ec68, user_id=a71fb581019a498e83d42ac3032c9725, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:28.060499 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:28.075801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1349/2710] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:45:28 2022] PUT /identity/v3/projects/5bf1a0573fdd4ca1a81512a2eda5ec68/users/a71fb581019a498e83d42ac3032c9725/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:28.086200 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9014-0125-417f-8526-22bf6b1d6bc9 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:28.086488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9014-0125-417f-8526-22bf6b1d6bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:28.086790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d9014-0125-417f-8526-22bf6b1d6bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:28.115466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-f38d9014-0125-417f-8526-22bf6b1d6bc9 None None] MFA Rules not processed for user `a71fb581019a498e83d42ac3032c9725`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:28.116807 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f38d9014-0125-417f-8526-22bf6b1d6bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:28.201648 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1362/2711] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:45:28.213750 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:28.215981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:28.275720 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37722a46-5afb-404b-a297-b7af72faabe0 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:28.280953 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1decac0-a75b-4519-9102-10467262eda9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91feeca74fe749fba52423aa28d48916', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:28.281646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1decac0-a75b-4519-9102-10467262eda9 service glance] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:28.281986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1decac0-a75b-4519-9102-10467262eda9 service glance] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:28.282948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1decac0-a75b-4519-9102-10467262eda9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:28.292524 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1decac0-a75b-4519-9102-10467262eda9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:28.294813 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1decac0-a75b-4519-9102-10467262eda9 service glance] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:28.304902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1350/2712] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:31.974037 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d9014-0125-417f-8526-22bf6b1d6bc9 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:31.975437 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-f38d9014-0125-417f-8526-22bf6b1d6bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:32.032284 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d9014-0125-417f-8526-22bf6b1d6bc9 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:32.035791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:32.036543 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:32.036828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:32.037090 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:32.039106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:32.102049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:32.103555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:32.115219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1363/2713] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:38.880864 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe130ce-9f58-4be9-9b94-d06c10a8f1da None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:38.881332 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe130ce-9f58-4be9-9b94-d06c10a8f1da None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:38.881450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe130ce-9f58-4be9-9b94-d06c10a8f1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:38.898507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-dbe130ce-9f58-4be9-9b94-d06c10a8f1da None None] MFA Rules not processed for user `ed2dae16f03c4eff9185087ed50120fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:38.899700 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-dbe130ce-9f58-4be9-9b94-d06c10a8f1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:38.906481 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1351/2714] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:59.321231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:59.382788 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a537e85-54f2-4311-9616-76ad8f4b2752 service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:59.387357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:59.388231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:59.388547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:59.389245 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] PATH_INFO: `/v3/users/a71fb581019a498e83d42ac3032c9725` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:59.390104 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71fb581019a498e83d42ac3032c9725)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:59.392207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:59.435757 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71fb581019a498e83d42ac3032c9725'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:59.447634 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71fb581019a498e83d42ac3032c9725'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:59.454146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71fb581019a498e83d42ac3032c9725'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:59.454849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71fb581019a498e83d42ac3032c9725'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:59.462541 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71fb581019a498e83d42ac3032c9725'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:59.468325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1364/2715] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:45:59 2022] DELETE /identity/v3/users/a71fb581019a498e83d42ac3032c9725 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:45:59.473304 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61a34-c93f-455f-9e93-f273e8c8a0b6 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:59.473809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61a34-c93f-455f-9e93-f273e8c8a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:59.473934 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c61a34-c93f-455f-9e93-f273e8c8a0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:59.491705 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-43c61a34-c93f-455f-9e93-f273e8c8a0b6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:45:59.492915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-43c61a34-c93f-455f-9e93-f273e8c8a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:59.557270 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1352/2716] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:45:59.567163 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:59.568628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:59.625358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5dea5-e8f0-4696-ad8d-9f15846f6c60 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:59.628944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27e3ed-a68e-45ff-be3c-c4761bd05aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:59.629602 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e3ed-a68e-45ff-be3c-c4761bd05aad service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:59.629884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e3ed-a68e-45ff-be3c-c4761bd05aad service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:59.630155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27e3ed-a68e-45ff-be3c-c4761bd05aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:59.638832 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27e3ed-a68e-45ff-be3c-c4761bd05aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:59.640235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27e3ed-a68e-45ff-be3c-c4761bd05aad service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:59.649201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1365/2717] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:45:59.919370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c61a34-c93f-455f-9e93-f273e8c8a0b6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:45:59.920835 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-43c61a34-c93f-455f-9e93-f273e8c8a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:45:59.937071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c61a34-c93f-455f-9e93-f273e8c8a0b6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:45:59.942130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:45:59.943025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:45:59.943143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:45:59.943407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] PATH_INFO: `/v3/projects/5bf1a0573fdd4ca1a81512a2eda5ec68` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:45:59.944580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf1a0573fdd4ca1a81512a2eda5ec68)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:45:59.946543 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:45:59.991140 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf1a0573fdd4ca1a81512a2eda5ec68', 'request_id': 'req-18b6f732-2eab-4786-a1f5-b540532f4abe'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:45:59.996280 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf1a0573fdd4ca1a81512a2eda5ec68', 'request_id': 'req-18b6f732-2eab-4786-a1f5-b540532f4abe'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:46:00.003993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf1a0573fdd4ca1a81512a2eda5ec68', 'request_id': 'req-18b6f732-2eab-4786-a1f5-b540532f4abe'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:46:00.014510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] The token cache is being invalidate because project 5bf1a0573fdd4ca1a81512a2eda5ec68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:46:00.014793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:46:00.015395 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-18b6f732-2eab-4786-a1f5-b540532f4abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:46:00.017391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1353/2718] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:45:59 2022] DELETE /identity/v3/projects/5bf1a0573fdd4ca1a81512a2eda5ec68 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:46:00.022298 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f37768-7c18-467f-a833-8628525d25ac None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.022585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f37768-7c18-467f-a833-8628525d25ac None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.022859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f37768-7c18-467f-a833-8628525d25ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.041700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e4f37768-7c18-467f-a833-8628525d25ac None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:46:00.042878 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e4f37768-7c18-467f-a833-8628525d25ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:00.100232 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1366/2719] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:46:00.107971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119da9-a685-4217-9bd0-dbdf894b9b6c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.108263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119da9-a685-4217-9bd0-dbdf894b9b6c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.108548 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1119da9-a685-4217-9bd0-dbdf894b9b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.126537 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f1119da9-a685-4217-9bd0-dbdf894b9b6c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:46:00.127739 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f1119da9-a685-4217-9bd0-dbdf894b9b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:00.135519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1354/2720] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:46:00.139449 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f37768-7c18-467f-a833-8628525d25ac None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:00.149224 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f37768-7c18-467f-a833-8628525d25ac None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:00.153699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:00.154338 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.154618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.154891 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.155609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:46:00.155914 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:00.158115 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:00.169277 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1367/2721] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:46:00.173221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1119da9-a685-4217-9bd0-dbdf894b9b6c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:00.183314 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1119da9-a685-4217-9bd0-dbdf894b9b6c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:00.188196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917119b-b4a8-4bc8-b036-64613420f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:00.189053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917119b-b4a8-4bc8-b036-64613420f6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.189390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917119b-b4a8-4bc8-b036-64613420f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.189679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917119b-b4a8-4bc8-b036-64613420f6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.191202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917119b-b4a8-4bc8-b036-64613420f6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:00.192502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917119b-b4a8-4bc8-b036-64613420f6c0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:00.217682 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1355/2722] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:46:00 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:46:00.222632 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:00.232369 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13391f6-c661-4014-9fcf-e8dd29bff85a admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:00.286701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb9556-e9d0-44ea-9334-14316da289ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:00.287365 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9556-e9d0-44ea-9334-14316da289ea admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.287654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9556-e9d0-44ea-9334-14316da289ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.287936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9556-e9d0-44ea-9334-14316da289ea admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.288658 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb9556-e9d0-44ea-9334-14316da289ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:00.290609 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb9556-e9d0-44ea-9334-14316da289ea admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:00.308906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1368/2723] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:46:00 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:46:00.313032 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917119b-b4a8-4bc8-b036-64613420f6c0 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:00.323949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917119b-b4a8-4bc8-b036-64613420f6c0 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:00.328498 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbadb-b84a-4c5a-b9c8-435b4cdbc0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:00.329180 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbadb-b84a-4c5a-b9c8-435b4cdbc0ca admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.330138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbadb-b84a-4c5a-b9c8-435b4cdbc0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.330416 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbadb-b84a-4c5a-b9c8-435b4cdbc0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.331136 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afbadb-b84a-4c5a-b9c8-435b4cdbc0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:00.332718 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afbadb-b84a-4c5a-b9c8-435b4cdbc0ca admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:00.343074 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1356/2724] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:46:00.346661 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb9556-e9d0-44ea-9334-14316da289ea admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:00.356517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb9556-e9d0-44ea-9334-14316da289ea admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:00.361083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9c0b4-3017-43ef-b9bb-7ed861749b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:00.361771 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c0b4-3017-43ef-b9bb-7ed861749b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.362060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c0b4-3017-43ef-b9bb-7ed861749b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.362339 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9c0b4-3017-43ef-b9bb-7ed861749b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.363080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9c0b4-3017-43ef-b9bb-7ed861749b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:00.364933 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9c0b4-3017-43ef-b9bb-7ed861749b37 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:00.374668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1369/2725] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:46:00.379143 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbadb-b84a-4c5a-b9c8-435b4cdbc0ca admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:00.388868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbadb-b84a-4c5a-b9c8-435b4cdbc0ca admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:00.394097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:00.394964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.395248 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.395523 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] PATH_INFO: `/v3/projects/0c4410fd6b2c46da89537b4923db6d89/users/e1b0351ac4564043b97f5499679cdc06/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.409376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4410fd6b2c46da89537b4923db6d89, user_id=e1b0351ac4564043b97f5499679cdc06, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:00.412036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:00.424508 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1357/2726] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:46:00 2022] PUT /identity/v3/projects/0c4410fd6b2c46da89537b4923db6d89/users/e1b0351ac4564043b97f5499679cdc06/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:46:00.429387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7ee5-f7db-400d-9e54-a53539675cf2 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.429714 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7ee5-f7db-400d-9e54-a53539675cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.430003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f7ee5-f7db-400d-9e54-a53539675cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.447790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-539f7ee5-f7db-400d-9e54-a53539675cf2 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:46:00.448982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-539f7ee5-f7db-400d-9e54-a53539675cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:00.505752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1370/2727] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:46:00.515248 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:00.517509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:00.572049 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3c8b-86d2-4d85-bd96-4c758899f692 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:00.575691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:00.576323 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:00.576607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:00.576884 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:00.586288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:00.587708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:00.596803 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1358/2728] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:46:01.181133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96111020-23c3-4670-8613-7687b7476bd3 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:01.181429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96111020-23c3-4670-8613-7687b7476bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:01.181745 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96111020-23c3-4670-8613-7687b7476bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:01.207830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-96111020-23c3-4670-8613-7687b7476bd3 None None] MFA Rules not processed for user `e1b0351ac4564043b97f5499679cdc06`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:46:01.209141 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-96111020-23c3-4670-8613-7687b7476bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:01.286092 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1371/2729] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:46:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:46:01.297943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:01.300253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:01.355320 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ffad0-e256-4f74-a196-56e03f86bb2c service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:01.358917 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad5e0d-95cd-44ad-8fef-96d5d3ff2b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:01.359574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5e0d-95cd-44ad-8fef-96d5d3ff2b3d service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:01.359858 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5e0d-95cd-44ad-8fef-96d5d3ff2b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:01.360133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad5e0d-95cd-44ad-8fef-96d5d3ff2b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:01.369068 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad5e0d-95cd-44ad-8fef-96d5d3ff2b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:01.370555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad5e0d-95cd-44ad-8fef-96d5d3ff2b3d service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:01.380668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1359/2730] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:46:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:46:02.709418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149f926-ff64-4aa8-923f-2ed2f3e01f3d None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:02.709970 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149f926-ff64-4aa8-923f-2ed2f3e01f3d None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:02.710080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149f926-ff64-4aa8-923f-2ed2f3e01f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:02.727316 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-7149f926-ff64-4aa8-923f-2ed2f3e01f3d None None] MFA Rules not processed for user `e1b0351ac4564043b97f5499679cdc06`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:46:02.728483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7149f926-ff64-4aa8-923f-2ed2f3e01f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:02.735177 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1372/2731] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:46:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:46:22.531944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2234d1-e42d-47ca-ba09-dd19bddb149b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:22.532458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2234d1-e42d-47ca-ba09-dd19bddb149b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:22.532576 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2234d1-e42d-47ca-ba09-dd19bddb149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:22.549451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-ae2234d1-e42d-47ca-ba09-dd19bddb149b None None] MFA Rules not processed for user `cb737cfd514343dfbfbc30816cf5f655`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:46:22.550582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ae2234d1-e42d-47ca-ba09-dd19bddb149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:22.605348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1360/2732] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:46:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:46:22.901337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149f926-ff64-4aa8-923f-2ed2f3e01f3d None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:22.902859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7149f926-ff64-4aa8-923f-2ed2f3e01f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:22.914334 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149f926-ff64-4aa8-923f-2ed2f3e01f3d None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:22.917772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd89b9-23b3-497c-a337-2bdec70b517d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:22.918399 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd89b9-23b3-497c-a337-2bdec70b517d service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:22.918676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd89b9-23b3-497c-a337-2bdec70b517d service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:22.918947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd89b9-23b3-497c-a337-2bdec70b517d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:22.920604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e7cd89b9-23b3-497c-a337-2bdec70b517d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:22.929467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd89b9-23b3-497c-a337-2bdec70b517d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:22.930906 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd89b9-23b3-497c-a337-2bdec70b517d service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:22.938585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1373/2733] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:46:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:46:34.718443 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2234d1-e42d-47ca-ba09-dd19bddb149b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:46:34.719533 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-ae2234d1-e42d-47ca-ba09-dd19bddb149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:34.791121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2234d1-e42d-47ca-ba09-dd19bddb149b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:46:34.795974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08f32-4d54-4917-8936-9e903d3ccd85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:46:34.796617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08f32-4d54-4917-8936-9e903d3ccd85 service placement] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:46:34.796899 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08f32-4d54-4917-8936-9e903d3ccd85 service placement] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:46:34.797170 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08f32-4d54-4917-8936-9e903d3ccd85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:46:34.799579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f6d08f32-4d54-4917-8936-9e903d3ccd85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:46:34.811003 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d08f32-4d54-4917-8936-9e903d3ccd85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:46:34.812597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d08f32-4d54-4917-8936-9e903d3ccd85 service placement] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:46:34.822874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1361/2734] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:46:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:47:07.431261 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4dd9b-7686-4c63-8b3b-53021846a248 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:47:07.431729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4dd9b-7686-4c63-8b3b-53021846a248 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:47:07.431835 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4dd9b-7686-4c63-8b3b-53021846a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:47:07.449660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-16d4dd9b-7686-4c63-8b3b-53021846a248 None None] MFA Rules not processed for user `e1b0351ac4564043b97f5499679cdc06`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:47:07.450853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-16d4dd9b-7686-4c63-8b3b-53021846a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:47:07.457593 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1374/2735] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:47:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:47:39.024887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85752732-37d4-41b2-8d31-72819091f49b None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:47:39.025429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85752732-37d4-41b2-8d31-72819091f49b None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:47:39.025429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85752732-37d4-41b2-8d31-72819091f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:47:39.044473 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-85752732-37d4-41b2-8d31-72819091f49b None None] MFA Rules not processed for user `cb737cfd514343dfbfbc30816cf5f655`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:47:39.045714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-85752732-37d4-41b2-8d31-72819091f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:47:39.052626 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1362/2736] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:47:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:48:02.636321 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4dd9b-7686-4c63-8b3b-53021846a248 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:02.646147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4dd9b-7686-4c63-8b3b-53021846a248 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:02.650357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:02.651021 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:02.651306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:02.651584 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:02.653677 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:02.666725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:02.668157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:02.678538 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1375/2737] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:48:05.755168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85752732-37d4-41b2-8d31-72819091f49b None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:05.766024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85752732-37d4-41b2-8d31-72819091f49b None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:05.771737 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:05.772617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:05.772901 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:05.773175 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] PATH_INFO: `/v3/users/e1b0351ac4564043b97f5499679cdc06` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:05.774412 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b0351ac4564043b97f5499679cdc06)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:05.776309 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:05.823870 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b0351ac4564043b97f5499679cdc06'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:05.835900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b0351ac4564043b97f5499679cdc06'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:05.836607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b0351ac4564043b97f5499679cdc06'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:05.843250 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b0351ac4564043b97f5499679cdc06'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:05.843879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b0351ac4564043b97f5499679cdc06'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:05.857001 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1363/2738] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:48:05 2022] DELETE /identity/v3/users/e1b0351ac4564043b97f5499679cdc06 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:48:06.069226 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:06.091252 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830a597-8ffb-4321-a319-398f59cafba4 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:06.179627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:06.180667 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:06.181049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:06.181613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] PATH_INFO: `/v3/projects/0c4410fd6b2c46da89537b4923db6d89` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:06.182963 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4410fd6b2c46da89537b4923db6d89)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:06.184982 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:06.238784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4410fd6b2c46da89537b4923db6d89', 'request_id': 'req-0752937a-31fb-4acb-9532-a38e0603a413'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:06.244238 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4410fd6b2c46da89537b4923db6d89', 'request_id': 'req-0752937a-31fb-4acb-9532-a38e0603a413'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:06.251578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4410fd6b2c46da89537b4923db6d89', 'request_id': 'req-0752937a-31fb-4acb-9532-a38e0603a413'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:06.263592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] The token cache is being invalidate because project 0c4410fd6b2c46da89537b4923db6d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:48:06.263877 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:06.264554 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:06.266123 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1376/2739] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:48:06 2022] DELETE /identity/v3/projects/0c4410fd6b2c46da89537b4923db6d89 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:48:09.575542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:09.577165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:09.593215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1a68e-d65e-4a33-be6b-dfcbb2c01502 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:09.657546 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:09.659017 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:09.659294 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:09.659565 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] PATH_INFO: `/v3/users/ed2dae16f03c4eff9185087ed50120fc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:09.660731 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2dae16f03c4eff9185087ed50120fc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:09.662733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:09.704867 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2dae16f03c4eff9185087ed50120fc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:09.716377 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2dae16f03c4eff9185087ed50120fc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:09.717036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2dae16f03c4eff9185087ed50120fc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:09.724168 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2dae16f03c4eff9185087ed50120fc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:09.724780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2dae16f03c4eff9185087ed50120fc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:09.737142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1364/2740] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:48:09 2022] DELETE /identity/v3/users/ed2dae16f03c4eff9185087ed50120fc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:48:09.904969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:09.906615 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:09.921664 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752937a-31fb-4acb-9532-a38e0603a413 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:09.977713 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:09.978496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:09.978776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:09.979048 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] PATH_INFO: `/v3/projects/d69ae02f1e0146c795d799160ac17d44` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:09.980190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69ae02f1e0146c795d799160ac17d44)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:09.982117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:10.031207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69ae02f1e0146c795d799160ac17d44', 'request_id': 'req-81342b63-931a-4b08-9aaa-daf1db8fdf0e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.036642 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69ae02f1e0146c795d799160ac17d44', 'request_id': 'req-81342b63-931a-4b08-9aaa-daf1db8fdf0e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.044199 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69ae02f1e0146c795d799160ac17d44', 'request_id': 'req-81342b63-931a-4b08-9aaa-daf1db8fdf0e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.054830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] The token cache is being invalidate because project d69ae02f1e0146c795d799160ac17d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:48:10.055117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.055738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.057257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1377/2741] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:48:09 2022] DELETE /identity/v3/projects/d69ae02f1e0146c795d799160ac17d44 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:48:10.061194 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:10.062609 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:10.075823 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08216d60-128e-48d3-9ca5-d20a83239a90 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:10.129848 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:10.130713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:10.130994 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:10.131266 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] PATH_INFO: `/v3/users/90ea3386eba440d49ff82f94022b9144` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:10.132425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ea3386eba440d49ff82f94022b9144)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:10.134477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:10.177743 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ea3386eba440d49ff82f94022b9144'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.189063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ea3386eba440d49ff82f94022b9144'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.189746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ea3386eba440d49ff82f94022b9144'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.196996 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ea3386eba440d49ff82f94022b9144'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.197652 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ea3386eba440d49ff82f94022b9144'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.211296 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1365/2742] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:48:10 2022] DELETE /identity/v3/users/90ea3386eba440d49ff82f94022b9144 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:48:10.381004 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:10.382516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:10.396689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81342b63-931a-4b08-9aaa-daf1db8fdf0e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:10.450861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:10.451720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:10.452008 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:10.452278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] PATH_INFO: `/v3/projects/b4db4ccb6b824dfa84c1d1a6fd0d92e8` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:10.453460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4db4ccb6b824dfa84c1d1a6fd0d92e8)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:10.455394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:10.499932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4db4ccb6b824dfa84c1d1a6fd0d92e8', 'request_id': 'req-0c4dcb06-5c55-4041-9079-7c7ac08c3933'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.505936 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4db4ccb6b824dfa84c1d1a6fd0d92e8', 'request_id': 'req-0c4dcb06-5c55-4041-9079-7c7ac08c3933'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.512870 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4db4ccb6b824dfa84c1d1a6fd0d92e8', 'request_id': 'req-0c4dcb06-5c55-4041-9079-7c7ac08c3933'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.523797 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] The token cache is being invalidate because project b4db4ccb6b824dfa84c1d1a6fd0d92e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:48:10.524079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.524689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:48:10.526257 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1378/2743] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:48:10 2022] DELETE /identity/v3/projects/b4db4ccb6b824dfa84c1d1a6fd0d92e8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:48:29.402126 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:29.403506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:29.458080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b8a8e-53a1-4b46-8a9d-506087f1bfeb admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:29.505368 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ee8e1-c7ea-4282-b4e6-76ca94fb92d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:29.506067 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ee8e1-c7ea-4282-b4e6-76ca94fb92d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:29.506351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ee8e1-c7ea-4282-b4e6-76ca94fb92d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:29.506628 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ee8e1-c7ea-4282-b4e6-76ca94fb92d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:29.509124 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-cf1ee8e1-c7ea-4282-b4e6-76ca94fb92d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:29.578829 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ee8e1-c7ea-4282-b4e6-76ca94fb92d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:29.580228 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ee8e1-c7ea-4282-b4e6-76ca94fb92d0 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:29.590824 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1366/2744] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:48:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:48:37.299931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:37.301864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:37.313992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dcb06-5c55-4041-9079-7c7ac08c3933 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:37.317816 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:37.318447 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:37.318806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:37.319139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:37.321002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:37.334283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:37.335882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:37.346520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1379/2745] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:48:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:48:44.146406 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b894f-518f-42df-9b8b-b4bd745a9a38 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:44.146992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b894f-518f-42df-9b8b-b4bd745a9a38 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:44.146992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b894f-518f-42df-9b8b-b4bd745a9a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:44.163843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-080b894f-518f-42df-9b8b-b4bd745a9a38 None None] MFA Rules not processed for user `cb737cfd514343dfbfbc30816cf5f655`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:48:44.165018 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-080b894f-518f-42df-9b8b-b4bd745a9a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:44.216712 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1367/2746] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:48:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:48:44.804764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:44.806192 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:44.872619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054030-dfff-4bab-b88e-ffeb6825b23b service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:44.877479 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:44.878145 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:44.878429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:44.879236 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:44.880989 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:44.891821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:44.893380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:44.903618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1380/2747] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:48:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:48:46.537286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b894f-518f-42df-9b8b-b4bd745a9a38 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:46.538977 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-080b894f-518f-42df-9b8b-b4bd745a9a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:46.598042 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b894f-518f-42df-9b8b-b4bd745a9a38 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:46.601600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:46.602254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:46.602542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:46.602822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:46.604558 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:46.614285 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:46.615717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:46.623780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1368/2748] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:48:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:48:55.288215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:48:55.289726 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:55.305027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60e624-7d65-45e7-ba16-b53cf957d4ce service placement] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:48:55.310454 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:48:55.311097 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:48:55.311380 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:48:55.311653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:48:55.313389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:48:55.325471 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:48:55.327073 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:48:55.337568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1381/2749] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:48:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:49:51.691782 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:51.693686 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:51.756322 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4451686-99cf-4b6e-ab74-6f0c13b87def service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:51.760877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:51.761723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:51.762006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:51.762272 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] PATH_INFO: `/v3/users/cb737cfd514343dfbfbc30816cf5f655` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:51.763455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb737cfd514343dfbfbc30816cf5f655)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:51.765354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:51.811580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb737cfd514343dfbfbc30816cf5f655'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:51.823449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb737cfd514343dfbfbc30816cf5f655'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:51.824145 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb737cfd514343dfbfbc30816cf5f655'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:51.830583 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb737cfd514343dfbfbc30816cf5f655'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:51.831195 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-0acf37a1-b6d7-4a20-9c5e-378cf02226d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb737cfd514343dfbfbc30816cf5f655'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:51.843185 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1369/2750] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:49:51 2022] DELETE /identity/v3/users/cb737cfd514343dfbfbc30816cf5f655 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:52.012053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:52.026929 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5399e1-df2a-4fd2-aeda-6fb76ef5cbd4 service nova] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:52.086819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:52.087668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.087947 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.088218 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] PATH_INFO: `/v3/projects/bbefc9c91dab46baa2707f01c83e48e2` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.089370 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbefc9c91dab46baa2707f01c83e48e2)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:52.091278 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:52.134572 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbefc9c91dab46baa2707f01c83e48e2', 'request_id': 'req-4e64b4a2-9988-421c-ac17-9249236452a4'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:52.139692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbefc9c91dab46baa2707f01c83e48e2', 'request_id': 'req-4e64b4a2-9988-421c-ac17-9249236452a4'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:52.147512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbefc9c91dab46baa2707f01c83e48e2', 'request_id': 'req-4e64b4a2-9988-421c-ac17-9249236452a4'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:52.157971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] The token cache is being invalidate because project bbefc9c91dab46baa2707f01c83e48e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:49:52.158136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:52.158707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-4e64b4a2-9988-421c-ac17-9249236452a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:52.161250 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1382/2751] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:49:52 2022] DELETE /identity/v3/projects/bbefc9c91dab46baa2707f01c83e48e2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:52.166109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a2969-4950-42c8-a990-08c6d8ab6f05 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.166391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a2969-4950-42c8-a990-08c6d8ab6f05 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.166664 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a2969-4950-42c8-a990-08c6d8ab6f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.183886 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-d31a2969-4950-42c8-a990-08c6d8ab6f05 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:52.185059 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d31a2969-4950-42c8-a990-08c6d8ab6f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:52.241421 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1370/2752] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:49:52.248916 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8627-55d7-42cd-b6bf-f2ef057465ea None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.249201 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8627-55d7-42cd-b6bf-f2ef057465ea None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.249476 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8627-55d7-42cd-b6bf-f2ef057465ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.266957 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-dcad8627-55d7-42cd-b6bf-f2ef057465ea None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:52.268066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-dcad8627-55d7-42cd-b6bf-f2ef057465ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:52.276217 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1383/2753] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:49:52.280374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a2969-4950-42c8-a990-08c6d8ab6f05 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:52.290451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a2969-4950-42c8-a990-08c6d8ab6f05 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:52.294954 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:52.295595 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.295877 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.296149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.296865 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:49:52.297166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:52.298784 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:52.310273 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1371/2754] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:49:52.314294 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad8627-55d7-42cd-b6bf-f2ef057465ea None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:52.323474 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad8627-55d7-42cd-b6bf-f2ef057465ea None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:52.328010 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9991d8-3530-400f-b1c5-c6e171112fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:52.328641 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9991d8-3530-400f-b1c5-c6e171112fbf admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.328921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9991d8-3530-400f-b1c5-c6e171112fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.329190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9991d8-3530-400f-b1c5-c6e171112fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.329909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9991d8-3530-400f-b1c5-c6e171112fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:52.331857 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9991d8-3530-400f-b1c5-c6e171112fbf admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:52.356529 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1384/2755] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:49:52 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:49:52.360095 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:52.372420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85238ab9-3e98-4d50-a0b0-601ae4e4a4a3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:52.425060 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c869b36-876a-41db-917a-5c6c2ab485a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:52.426404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869b36-876a-41db-917a-5c6c2ab485a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.426685 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869b36-876a-41db-917a-5c6c2ab485a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.426958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869b36-876a-41db-917a-5c6c2ab485a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.427643 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c869b36-876a-41db-917a-5c6c2ab485a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:52.429564 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c869b36-876a-41db-917a-5c6c2ab485a9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:52.447616 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1372/2756] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:49:52 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:49:52.451759 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9991d8-3530-400f-b1c5-c6e171112fbf admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:52.461950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9991d8-3530-400f-b1c5-c6e171112fbf admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:52.466466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8ebb2-2db5-4edd-9d53-c2a5243f91e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:52.467117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8ebb2-2db5-4edd-9d53-c2a5243f91e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.467396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8ebb2-2db5-4edd-9d53-c2a5243f91e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.467672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8ebb2-2db5-4edd-9d53-c2a5243f91e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.468393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8ebb2-2db5-4edd-9d53-c2a5243f91e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:52.470027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8ebb2-2db5-4edd-9d53-c2a5243f91e5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:52.480858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1385/2757] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:49:52.484510 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c869b36-876a-41db-917a-5c6c2ab485a9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:52.494879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c869b36-876a-41db-917a-5c6c2ab485a9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:52.499477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95001dd8-e7f1-44f4-8878-eb8cb8eea754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:52.500133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95001dd8-e7f1-44f4-8878-eb8cb8eea754 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.500425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95001dd8-e7f1-44f4-8878-eb8cb8eea754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.500706 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95001dd8-e7f1-44f4-8878-eb8cb8eea754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.501434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95001dd8-e7f1-44f4-8878-eb8cb8eea754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:52.503123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95001dd8-e7f1-44f4-8878-eb8cb8eea754 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:52.512831 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1373/2758] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:49:52.516808 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8ebb2-2db5-4edd-9d53-c2a5243f91e5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:52.527026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8ebb2-2db5-4edd-9d53-c2a5243f91e5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:52.531478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:52.532343 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.532627 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.532902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] PATH_INFO: `/v3/projects/2916873d987d427191912a741b2eb373/users/dad07833fe1d4c5a952969a5befe5cbc/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.547624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2916873d987d427191912a741b2eb373, user_id=dad07833fe1d4c5a952969a5befe5cbc, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:52.550358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:52.563488 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1386/2759] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:49:52 2022] PUT /identity/v3/projects/2916873d987d427191912a741b2eb373/users/dad07833fe1d4c5a952969a5befe5cbc/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:52.574501 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaab30-eab1-4cb7-a01e-3f38273467d9 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.574791 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaab30-eab1-4cb7-a01e-3f38273467d9 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.575070 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaab30-eab1-4cb7-a01e-3f38273467d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.601083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-7bcaab30-eab1-4cb7-a01e-3f38273467d9 None None] MFA Rules not processed for user `dad07833fe1d4c5a952969a5befe5cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:52.602306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-7bcaab30-eab1-4cb7-a01e-3f38273467d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:52.663161 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1374/2760] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:49:52.674146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:52.675827 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:52.746063 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63038c1b-81e5-40d5-ad4b-fd15d2ee7335 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:52.751432 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475740d-aa3a-468a-83b8-bb14d5b6e2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:52.752065 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475740d-aa3a-468a-83b8-bb14d5b6e2dd service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:52.752346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475740d-aa3a-468a-83b8-bb14d5b6e2dd service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:52.752620 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475740d-aa3a-468a-83b8-bb14d5b6e2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:52.760013 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475740d-aa3a-468a-83b8-bb14d5b6e2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:52.761592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475740d-aa3a-468a-83b8-bb14d5b6e2dd service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:52.770448 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1387/2761] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:49:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:49:52.976904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaab30-eab1-4cb7-a01e-3f38273467d9 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:53.037446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaab30-eab1-4cb7-a01e-3f38273467d9 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:53.041964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:53.042828 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.043115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.043392 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] PATH_INFO: `/v3/users/dad07833fe1d4c5a952969a5befe5cbc` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.044568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad07833fe1d4c5a952969a5befe5cbc)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:53.046531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:53.091375 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad07833fe1d4c5a952969a5befe5cbc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.102881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad07833fe1d4c5a952969a5befe5cbc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.103557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad07833fe1d4c5a952969a5befe5cbc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.110047 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad07833fe1d4c5a952969a5befe5cbc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.110667 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad07833fe1d4c5a952969a5befe5cbc'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.122942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1375/2762] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:49:52 2022] DELETE /identity/v3/users/dad07833fe1d4c5a952969a5befe5cbc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:53.127530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be725a8-be44-441a-ac2d-7fc0c23f00a7 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.128000 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be725a8-be44-441a-ac2d-7fc0c23f00a7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.128139 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be725a8-be44-441a-ac2d-7fc0c23f00a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.144752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0be725a8-be44-441a-ac2d-7fc0c23f00a7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:53.145966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0be725a8-be44-441a-ac2d-7fc0c23f00a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:53.201917 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1388/2763] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:49:53.211478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:53.212986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:53.267728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529928d-5aaf-46a5-8869-4736c85c7e11 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:53.271850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb57829-8582-42f4-ae47-c4e06cc99928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:53.272485 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57829-8582-42f4-ae47-c4e06cc99928 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.272771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57829-8582-42f4-ae47-c4e06cc99928 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.273046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57829-8582-42f4-ae47-c4e06cc99928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.281830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb57829-8582-42f4-ae47-c4e06cc99928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:53.283252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb57829-8582-42f4-ae47-c4e06cc99928 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:53.293019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1376/2764] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:49:53.548700 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be725a8-be44-441a-ac2d-7fc0c23f00a7 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:53.550418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0be725a8-be44-441a-ac2d-7fc0c23f00a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:53.565398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be725a8-be44-441a-ac2d-7fc0c23f00a7 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:53.572930 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:53.573971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.574144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.574467 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] PATH_INFO: `/v3/projects/2916873d987d427191912a741b2eb373` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.575604 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2916873d987d427191912a741b2eb373)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:53.577502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:53.623809 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2916873d987d427191912a741b2eb373', 'request_id': 'req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.629651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2916873d987d427191912a741b2eb373', 'request_id': 'req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.637426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2916873d987d427191912a741b2eb373', 'request_id': 'req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.649106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] The token cache is being invalidate because project 2916873d987d427191912a741b2eb373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:49:53.649388 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.650027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-6cf8504d-f28e-4eee-b9f8-4ce09f0429fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:53.651730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1389/2765] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:49:53 2022] DELETE /identity/v3/projects/2916873d987d427191912a741b2eb373 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:53.657531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962a7a-cff6-40a0-81d0-4d42382ff41a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.657836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962a7a-cff6-40a0-81d0-4d42382ff41a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.658107 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962a7a-cff6-40a0-81d0-4d42382ff41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.675023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-01962a7a-cff6-40a0-81d0-4d42382ff41a None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:53.676257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-01962a7a-cff6-40a0-81d0-4d42382ff41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:53.732511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1377/2766] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:49:53.740120 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82205b-c07d-4d33-9b2e-dab61d0dc609 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.740406 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82205b-c07d-4d33-9b2e-dab61d0dc609 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.740686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82205b-c07d-4d33-9b2e-dab61d0dc609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.758780 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-9d82205b-c07d-4d33-9b2e-dab61d0dc609 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:53.759967 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-9d82205b-c07d-4d33-9b2e-dab61d0dc609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:53.767692 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1390/2767] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:49:53.772203 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962a7a-cff6-40a0-81d0-4d42382ff41a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:53.781445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962a7a-cff6-40a0-81d0-4d42382ff41a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:53.785984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:53.786630 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.786914 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.787193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.787912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:49:53.788220 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:53.789843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:53.802286 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1378/2768] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:49:53.805866 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82205b-c07d-4d33-9b2e-dab61d0dc609 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:53.814859 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82205b-c07d-4d33-9b2e-dab61d0dc609 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:53.820222 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8f6a-316b-4424-8b1a-32b4508e67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:53.820861 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8f6a-316b-4424-8b1a-32b4508e67c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.821144 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8f6a-316b-4424-8b1a-32b4508e67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.821418 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8f6a-316b-4424-8b1a-32b4508e67c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.822136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc8f6a-316b-4424-8b1a-32b4508e67c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:53.824039 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc8f6a-316b-4424-8b1a-32b4508e67c6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:53.848468 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1391/2769] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:49:53 2022] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:49:53.852436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:53.862149 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dae75-867c-4ffe-828a-2bd9be7ac269 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:53.916376 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5758d15-5d2a-4cf9-aa94-39be5772f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:53.917052 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5758d15-5d2a-4cf9-aa94-39be5772f826 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.917335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5758d15-5d2a-4cf9-aa94-39be5772f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.917637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5758d15-5d2a-4cf9-aa94-39be5772f826 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.918372 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5758d15-5d2a-4cf9-aa94-39be5772f826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:53.920275 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5758d15-5d2a-4cf9-aa94-39be5772f826 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:53.939009 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1379/2770] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:49:53 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:49:53.943836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8f6a-316b-4424-8b1a-32b4508e67c6 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:53.953756 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8f6a-316b-4424-8b1a-32b4508e67c6 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:53.959005 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bfe1e-84d8-4660-a074-ce352c03e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:53.959651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bfe1e-84d8-4660-a074-ce352c03e398 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.959937 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bfe1e-84d8-4660-a074-ce352c03e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.960215 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bfe1e-84d8-4660-a074-ce352c03e398 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.960962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bfe1e-84d8-4660-a074-ce352c03e398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:53.962626 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bfe1e-84d8-4660-a074-ce352c03e398 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:53.972998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1392/2771] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:49:53.977048 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5758d15-5d2a-4cf9-aa94-39be5772f826 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:53.987083 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5758d15-5d2a-4cf9-aa94-39be5772f826 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:53.991733 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07370eef-cbf5-4039-a4c9-2f5cfc03d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:53.992390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07370eef-cbf5-4039-a4c9-2f5cfc03d83c admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:53.992668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07370eef-cbf5-4039-a4c9-2f5cfc03d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:53.992942 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07370eef-cbf5-4039-a4c9-2f5cfc03d83c admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:53.993709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07370eef-cbf5-4039-a4c9-2f5cfc03d83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:53.995301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07370eef-cbf5-4039-a4c9-2f5cfc03d83c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.005464 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1380/2772] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:49:54.009483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bfe1e-84d8-4660-a074-ce352c03e398 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.019079 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bfe1e-84d8-4660-a074-ce352c03e398 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.024210 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343271e5-3503-4c4b-aa68-5cbee40fb620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.025076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343271e5-3503-4c4b-aa68-5cbee40fb620 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.025354 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343271e5-3503-4c4b-aa68-5cbee40fb620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.025654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343271e5-3503-4c4b-aa68-5cbee40fb620 admin admin] PATH_INFO: `/v3/projects/ec39be1702c347e68ef83c24f078780e/users/ce9f11d7dffe4895a1bfbef6ab8b0bc6/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.039491 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343271e5-3503-4c4b-aa68-5cbee40fb620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec39be1702c347e68ef83c24f078780e, user_id=ce9f11d7dffe4895a1bfbef6ab8b0bc6, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.042183 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343271e5-3503-4c4b-aa68-5cbee40fb620 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.055118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1393/2773] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:49:54 2022] PUT /identity/v3/projects/ec39be1702c347e68ef83c24f078780e/users/ce9f11d7dffe4895a1bfbef6ab8b0bc6/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:54.065044 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42271e97-265e-480b-98d0-cf0dc319315e None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.065337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42271e97-265e-480b-98d0-cf0dc319315e None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.065651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42271e97-265e-480b-98d0-cf0dc319315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.092119 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-42271e97-265e-480b-98d0-cf0dc319315e None None] MFA Rules not processed for user `ce9f11d7dffe4895a1bfbef6ab8b0bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:54.093290 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-42271e97-265e-480b-98d0-cf0dc319315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:54.153466 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1381/2774] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:49:54.157882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343271e5-3503-4c4b-aa68-5cbee40fb620 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.216242 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343271e5-3503-4c4b-aa68-5cbee40fb620 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.220718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9435a5-be88-4909-842b-91e19eaf6102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.221357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9435a5-be88-4909-842b-91e19eaf6102 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.221663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9435a5-be88-4909-842b-91e19eaf6102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.221938 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9435a5-be88-4909-842b-91e19eaf6102 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.222618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9435a5-be88-4909-842b-91e19eaf6102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.224502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9435a5-be88-4909-842b-91e19eaf6102 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.248332 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1394/2775] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:49:54 2022] POST /identity/v3/projects => generated 401 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:49:54.252336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42271e97-265e-480b-98d0-cf0dc319315e None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.263370 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42271e97-265e-480b-98d0-cf0dc319315e None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.318774 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1519d0d-8101-45a1-a92b-2a1b8358b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.319434 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1519d0d-8101-45a1-a92b-2a1b8358b8ec admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.319717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1519d0d-8101-45a1-a92b-2a1b8358b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.319992 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1519d0d-8101-45a1-a92b-2a1b8358b8ec admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.320680 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1519d0d-8101-45a1-a92b-2a1b8358b8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.322625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1519d0d-8101-45a1-a92b-2a1b8358b8ec admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.342240 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1382/2776] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:49:54 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:49:54.346324 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9435a5-be88-4909-842b-91e19eaf6102 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.356262 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9435a5-be88-4909-842b-91e19eaf6102 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.360717 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945cacd-981b-4e7d-95bd-fb217e0f077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.361357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945cacd-981b-4e7d-95bd-fb217e0f077d admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.361676 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945cacd-981b-4e7d-95bd-fb217e0f077d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.361951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945cacd-981b-4e7d-95bd-fb217e0f077d admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.362663 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945cacd-981b-4e7d-95bd-fb217e0f077d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.364747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945cacd-981b-4e7d-95bd-fb217e0f077d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.375382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1395/2777] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:49:54.380178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1519d0d-8101-45a1-a92b-2a1b8358b8ec admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.389961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1519d0d-8101-45a1-a92b-2a1b8358b8ec admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.394546 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5218e32-1fd0-4cba-8fb1-0dde4f72d57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.395417 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5218e32-1fd0-4cba-8fb1-0dde4f72d57d admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.395699 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5218e32-1fd0-4cba-8fb1-0dde4f72d57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.395974 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5218e32-1fd0-4cba-8fb1-0dde4f72d57d admin admin] PATH_INFO: `/v3/projects/b3df3decdaf44ff6a6c372009f1f56ef/users/6c9550dcd4624e0bae8445a13bd5815d/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.410449 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5218e32-1fd0-4cba-8fb1-0dde4f72d57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3df3decdaf44ff6a6c372009f1f56ef, user_id=6c9550dcd4624e0bae8445a13bd5815d, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.413087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5218e32-1fd0-4cba-8fb1-0dde4f72d57d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.425046 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1383/2778] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:49:54 2022] PUT /identity/v3/projects/b3df3decdaf44ff6a6c372009f1f56ef/users/6c9550dcd4624e0bae8445a13bd5815d/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:54.429483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945cacd-981b-4e7d-95bd-fb217e0f077d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.439302 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945cacd-981b-4e7d-95bd-fb217e0f077d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.494014 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f413596-b967-4833-918a-77f56694f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.494673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413596-b967-4833-918a-77f56694f1ee admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.494951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413596-b967-4833-918a-77f56694f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.495221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f413596-b967-4833-918a-77f56694f1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.495962 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f413596-b967-4833-918a-77f56694f1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.497558 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f413596-b967-4833-918a-77f56694f1ee admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.506924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1396/2779] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:49:54.511006 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5218e32-1fd0-4cba-8fb1-0dde4f72d57d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.521109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5218e32-1fd0-4cba-8fb1-0dde4f72d57d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.525698 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.526568 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.526850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.527123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] PATH_INFO: `/v3/projects/b3df3decdaf44ff6a6c372009f1f56ef/users/6c9550dcd4624e0bae8445a13bd5815d/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.529056 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3df3decdaf44ff6a6c372009f1f56ef, user_id=6c9550dcd4624e0bae8445a13bd5815d, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.531693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.541982 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1384/2780] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:49:54 2022] PUT /identity/v3/projects/b3df3decdaf44ff6a6c372009f1f56ef/users/6c9550dcd4624e0bae8445a13bd5815d/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:54.553822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc699a-5f76-4594-9d73-5efa30b618fc None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.554117 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc699a-5f76-4594-9d73-5efa30b618fc None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.554401 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc699a-5f76-4594-9d73-5efa30b618fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.579828 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-14bc699a-5f76-4594-9d73-5efa30b618fc None None] MFA Rules not processed for user `6c9550dcd4624e0bae8445a13bd5815d`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:54.581031 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-14bc699a-5f76-4594-9d73-5efa30b618fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:54.646223 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1397/2781] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:49:54.656612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.658330 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:54.713355 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716da2fe-fc3c-47c8-9b1b-cb1dce546126 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.717010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881a988-a534-488f-ab47-6b76db2225cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.717676 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881a988-a534-488f-ab47-6b76db2225cc service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.717964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881a988-a534-488f-ab47-6b76db2225cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.718242 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881a988-a534-488f-ab47-6b76db2225cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.727477 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881a988-a534-488f-ab47-6b76db2225cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.728904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881a988-a534-488f-ab47-6b76db2225cc service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.738708 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1385/2782] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:49:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:49:54.811867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc699a-5f76-4594-9d73-5efa30b618fc None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:54.823419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc699a-5f76-4594-9d73-5efa30b618fc None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:54.826972 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85c068-e45d-4c7f-a0f4-51cbd95bd915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:54.827603 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c068-e45d-4c7f-a0f4-51cbd95bd915 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:54.827879 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c068-e45d-4c7f-a0f4-51cbd95bd915 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:54.828147 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85c068-e45d-4c7f-a0f4-51cbd95bd915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:54.880915 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85c068-e45d-4c7f-a0f4-51cbd95bd915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:54.882357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85c068-e45d-4c7f-a0f4-51cbd95bd915 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:54.890811 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1398/2783] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:49:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:49:58.873467 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881a988-a534-488f-ab47-6b76db2225cc service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:58.935902 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881a988-a534-488f-ab47-6b76db2225cc service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:58.940393 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:58.941856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:58.942139 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:58.942690 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] PATH_INFO: `/v3/users/ce9f11d7dffe4895a1bfbef6ab8b0bc6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:58.943851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9f11d7dffe4895a1bfbef6ab8b0bc6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:58.945780 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:58.988696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9f11d7dffe4895a1bfbef6ab8b0bc6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.001167 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9f11d7dffe4895a1bfbef6ab8b0bc6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.001856 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9f11d7dffe4895a1bfbef6ab8b0bc6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.008949 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9f11d7dffe4895a1bfbef6ab8b0bc6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.009608 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9f11d7dffe4895a1bfbef6ab8b0bc6'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.022252 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1386/2784] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:49:58 2022] DELETE /identity/v3/users/ce9f11d7dffe4895a1bfbef6ab8b0bc6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:59.026764 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3139a-4e6e-4498-bd09-d6ee77d5eac7 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:59.027246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3139a-4e6e-4498-bd09-d6ee77d5eac7 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:59.027348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3139a-4e6e-4498-bd09-d6ee77d5eac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:59.044283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-4ba3139a-4e6e-4498-bd09-d6ee77d5eac7 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:49:59.045496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4ba3139a-4e6e-4498-bd09-d6ee77d5eac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:59.101295 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1399/2785] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:49:59.111043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:59.112408 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:59.167709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb54f6-8520-4805-a992-73e3faa046f9 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:59.171435 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae861-1064-406f-a773-31b0e571ee29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:59.172076 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae861-1064-406f-a773-31b0e571ee29 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:59.172361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae861-1064-406f-a773-31b0e571ee29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:59.172640 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae861-1064-406f-a773-31b0e571ee29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:59.181411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ae861-1064-406f-a773-31b0e571ee29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:59.182900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ae861-1064-406f-a773-31b0e571ee29 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:59.192801 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1387/2786] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:49:59.449096 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3139a-4e6e-4498-bd09-d6ee77d5eac7 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:59.450688 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4ba3139a-4e6e-4498-bd09-d6ee77d5eac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:59.462607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3139a-4e6e-4498-bd09-d6ee77d5eac7 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:59.467196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:59.468060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:59.468347 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:59.468624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] PATH_INFO: `/v3/projects/ec39be1702c347e68ef83c24f078780e` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:59.469851 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec39be1702c347e68ef83c24f078780e)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:59.471769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:59.518939 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec39be1702c347e68ef83c24f078780e', 'request_id': 'req-bf46a128-9e98-48eb-8bac-1b57efc17c99'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.524062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec39be1702c347e68ef83c24f078780e', 'request_id': 'req-bf46a128-9e98-48eb-8bac-1b57efc17c99'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.530900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec39be1702c347e68ef83c24f078780e', 'request_id': 'req-bf46a128-9e98-48eb-8bac-1b57efc17c99'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.541209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] The token cache is being invalidate because project ec39be1702c347e68ef83c24f078780e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:49:59.541495 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.542142 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.543649 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1400/2787] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:49:59 2022] DELETE /identity/v3/projects/ec39be1702c347e68ef83c24f078780e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:49:59.547579 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae861-1064-406f-a773-31b0e571ee29 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:59.557624 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae861-1064-406f-a773-31b0e571ee29 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:49:59.611738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:49:59.612600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:49:59.613379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:49:59.613688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] PATH_INFO: `/v3/users/6c9550dcd4624e0bae8445a13bd5815d` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:49:59.614874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9550dcd4624e0bae8445a13bd5815d)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:49:59.616794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:49:59.661287 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9550dcd4624e0bae8445a13bd5815d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.672857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9550dcd4624e0bae8445a13bd5815d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.673520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9550dcd4624e0bae8445a13bd5815d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.680658 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9550dcd4624e0bae8445a13bd5815d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.681288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-e62d82b0-92b9-4e52-84b5-4a4bda04db33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9550dcd4624e0bae8445a13bd5815d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:49:59.695215 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1388/2788] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:49:59 2022] DELETE /identity/v3/users/6c9550dcd4624e0bae8445a13bd5815d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:49:59.951599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:49:59.953051 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:49:59.966686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46a128-9e98-48eb-8bac-1b57efc17c99 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.023175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.024068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.024348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.024621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] PATH_INFO: `/v3/projects/b3df3decdaf44ff6a6c372009f1f56ef` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.025821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3df3decdaf44ff6a6c372009f1f56ef)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.027708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.070452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3df3decdaf44ff6a6c372009f1f56ef', 'request_id': 'req-2a69f8e1-930e-4378-8db3-b83cccf7e03a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:00.075512 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3df3decdaf44ff6a6c372009f1f56ef', 'request_id': 'req-2a69f8e1-930e-4378-8db3-b83cccf7e03a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:00.082582 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3df3decdaf44ff6a6c372009f1f56ef', 'request_id': 'req-2a69f8e1-930e-4378-8db3-b83cccf7e03a'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:00.092902 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] The token cache is being invalidate because project b3df3decdaf44ff6a6c372009f1f56ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:50:00.093188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:00.093830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-2a69f8e1-930e-4378-8db3-b83cccf7e03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:00.095325 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1401/2789] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:49:59 2022] DELETE /identity/v3/projects/b3df3decdaf44ff6a6c372009f1f56ef => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:50:00.100259 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40f987-6209-47e0-a634-1982b9d43be6 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.100735 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40f987-6209-47e0-a634-1982b9d43be6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.100841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40f987-6209-47e0-a634-1982b9d43be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.118509 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-4f40f987-6209-47e0-a634-1982b9d43be6 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:00.119704 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-4f40f987-6209-47e0-a634-1982b9d43be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:00.176433 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1389/2790] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:00.184149 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d13b9-4cc9-463d-82ea-5fcd0a8759c4 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.184443 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d13b9-4cc9-463d-82ea-5fcd0a8759c4 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.184725 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d13b9-4cc9-463d-82ea-5fcd0a8759c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.203153 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-963d13b9-4cc9-463d-82ea-5fcd0a8759c4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:00.204344 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-963d13b9-4cc9-463d-82ea-5fcd0a8759c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:00.212118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1402/2791] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:00.215981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40f987-6209-47e0-a634-1982b9d43be6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.225133 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40f987-6209-47e0-a634-1982b9d43be6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.229817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.230458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.230738 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.231010 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.231724 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:50:00.232030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.233644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.245396 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1390/2792] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:50:00.249451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d13b9-4cc9-463d-82ea-5fcd0a8759c4 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.259172 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d13b9-4cc9-463d-82ea-5fcd0a8759c4 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.263804 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff5a69-5b5b-4632-a649-02075494d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.264444 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff5a69-5b5b-4632-a649-02075494d5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.264731 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff5a69-5b5b-4632-a649-02075494d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.265009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff5a69-5b5b-4632-a649-02075494d5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.265732 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff5a69-5b5b-4632-a649-02075494d5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.267624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff5a69-5b5b-4632-a649-02075494d5c9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.293358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1403/2793] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:50:00 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:00.297505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.307379 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a491-989a-4d0c-b107-078aac9b98d3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.366053 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031e2a2-6849-44e0-9828-ef9732025453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.366639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031e2a2-6849-44e0-9828-ef9732025453 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.366925 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031e2a2-6849-44e0-9828-ef9732025453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.367200 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031e2a2-6849-44e0-9828-ef9732025453 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.367878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031e2a2-6849-44e0-9828-ef9732025453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.369818 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031e2a2-6849-44e0-9828-ef9732025453 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.391950 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1391/2794] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:50:00 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:50:00.393178 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff5a69-5b5b-4632-a649-02075494d5c9 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.403818 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff5a69-5b5b-4632-a649-02075494d5c9 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.408405 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011198-348a-4821-b590-cb68ffc6fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.409053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011198-348a-4821-b590-cb68ffc6fbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.409336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011198-348a-4821-b590-cb68ffc6fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.409647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d011198-348a-4821-b590-cb68ffc6fbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.410728 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011198-348a-4821-b590-cb68ffc6fbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.415246 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d011198-348a-4821-b590-cb68ffc6fbe4 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.426896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1404/2795] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:00.430999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031e2a2-6849-44e0-9828-ef9732025453 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.440781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031e2a2-6849-44e0-9828-ef9732025453 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.446156 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beb097-c2f7-4d74-9167-dfda718f0270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.446806 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb097-c2f7-4d74-9167-dfda718f0270 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.447092 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb097-c2f7-4d74-9167-dfda718f0270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.447478 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb097-c2f7-4d74-9167-dfda718f0270 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.448202 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beb097-c2f7-4d74-9167-dfda718f0270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.449799 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beb097-c2f7-4d74-9167-dfda718f0270 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.460134 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1392/2796] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:50:00.464280 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011198-348a-4821-b590-cb68ffc6fbe4 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.473981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d011198-348a-4821-b590-cb68ffc6fbe4 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.478505 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af55a4-2abd-4cac-8d70-01efc18b99b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.482814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af55a4-2abd-4cac-8d70-01efc18b99b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.482814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af55a4-2abd-4cac-8d70-01efc18b99b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.482814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af55a4-2abd-4cac-8d70-01efc18b99b6 admin admin] PATH_INFO: `/v3/projects/319c6dbbf0b24eddb1831e9d34ff4c32/users/8368487b38844ca89ec786c86d3e971e/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.494429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af55a4-2abd-4cac-8d70-01efc18b99b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319c6dbbf0b24eddb1831e9d34ff4c32, user_id=8368487b38844ca89ec786c86d3e971e, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.497111 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af55a4-2abd-4cac-8d70-01efc18b99b6 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.510814 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1405/2797] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:00 2022] PUT /identity/v3/projects/319c6dbbf0b24eddb1831e9d34ff4c32/users/8368487b38844ca89ec786c86d3e971e/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:50:00.521534 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7fd9-7624-4be1-b7db-88e7a9bd39c6 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.521854 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7fd9-7624-4be1-b7db-88e7a9bd39c6 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.522152 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7fd9-7624-4be1-b7db-88e7a9bd39c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.547166 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-f59b7fd9-7624-4be1-b7db-88e7a9bd39c6 None None] MFA Rules not processed for user `8368487b38844ca89ec786c86d3e971e`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:00.548336 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-f59b7fd9-7624-4be1-b7db-88e7a9bd39c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:00.613459 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1393/2798] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:00.617984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af55a4-2abd-4cac-8d70-01efc18b99b6 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.683459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af55a4-2abd-4cac-8d70-01efc18b99b6 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.688055 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704aeb-aa72-43ba-993c-de9934dba307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.688702 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704aeb-aa72-43ba-993c-de9934dba307 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.688985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704aeb-aa72-43ba-993c-de9934dba307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.689255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50704aeb-aa72-43ba-993c-de9934dba307 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.689966 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50704aeb-aa72-43ba-993c-de9934dba307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.692607 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50704aeb-aa72-43ba-993c-de9934dba307 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.716774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1406/2799] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:50:00 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:00.720785 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b7fd9-7624-4be1-b7db-88e7a9bd39c6 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.731080 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b7fd9-7624-4be1-b7db-88e7a9bd39c6 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.785679 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8e057-da96-465f-9d7a-3ba12e3fe841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.786419 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8e057-da96-465f-9d7a-3ba12e3fe841 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.786707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8e057-da96-465f-9d7a-3ba12e3fe841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.786985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8e057-da96-465f-9d7a-3ba12e3fe841 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.787678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8e057-da96-465f-9d7a-3ba12e3fe841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.789610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8e057-da96-465f-9d7a-3ba12e3fe841 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.810742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1394/2800] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:50:00 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:50:00.814622 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704aeb-aa72-43ba-993c-de9934dba307 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.825459 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50704aeb-aa72-43ba-993c-de9934dba307 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.830026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa028-9cd6-491b-b017-6c694b923cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.830674 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa028-9cd6-491b-b017-6c694b923cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.830959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa028-9cd6-491b-b017-6c694b923cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.831234 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aa028-9cd6-491b-b017-6c694b923cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.831950 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa028-9cd6-491b-b017-6c694b923cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.833534 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aa028-9cd6-491b-b017-6c694b923cd7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.843662 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1407/2801] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:50:00.847453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8e057-da96-465f-9d7a-3ba12e3fe841 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.856895 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8e057-da96-465f-9d7a-3ba12e3fe841 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.861284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b14b-e50b-4789-a7c3-b021a3ea9b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.862172 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b14b-e50b-4789-a7c3-b021a3ea9b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.862453 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b14b-e50b-4789-a7c3-b021a3ea9b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.862723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b14b-e50b-4789-a7c3-b021a3ea9b2d admin admin] PATH_INFO: `/v3/projects/eb0c581d51fd4155bf7452fda38a0d5a/users/2fdc40412a394820950c115b86a506a0/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.877425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b14b-e50b-4789-a7c3-b021a3ea9b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0c581d51fd4155bf7452fda38a0d5a, user_id=2fdc40412a394820950c115b86a506a0, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.880663 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b14b-e50b-4789-a7c3-b021a3ea9b2d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.893028 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1395/2802] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:00 2022] PUT /identity/v3/projects/eb0c581d51fd4155bf7452fda38a0d5a/users/2fdc40412a394820950c115b86a506a0/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:00.898961 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa028-9cd6-491b-b017-6c694b923cd7 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.911752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aa028-9cd6-491b-b017-6c694b923cd7 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.965821 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59838323-a56d-4c35-9a45-9f7b2a75e014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.966478 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838323-a56d-4c35-9a45-9f7b2a75e014 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.966766 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838323-a56d-4c35-9a45-9f7b2a75e014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:00.967042 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59838323-a56d-4c35-9a45-9f7b2a75e014 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:00.967752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59838323-a56d-4c35-9a45-9f7b2a75e014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:00.969336 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59838323-a56d-4c35-9a45-9f7b2a75e014 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:00.978617 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1408/2803] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:00.982702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b14b-e50b-4789-a7c3-b021a3ea9b2d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:00.993348 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b14b-e50b-4789-a7c3-b021a3ea9b2d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:00.998794 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:00.999668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:00.999944 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:01.000212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] PATH_INFO: `/v3/projects/eb0c581d51fd4155bf7452fda38a0d5a/users/2fdc40412a394820950c115b86a506a0/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:01.002181 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0c581d51fd4155bf7452fda38a0d5a, user_id=2fdc40412a394820950c115b86a506a0, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:01.005382 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:01.015269 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1396/2804] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:00 2022] PUT /identity/v3/projects/eb0c581d51fd4155bf7452fda38a0d5a/users/2fdc40412a394820950c115b86a506a0/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:01.026520 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac80d-0ac2-436f-849d-52f74209c0e8 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:01.026822 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac80d-0ac2-436f-849d-52f74209c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:01.027099 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac80d-0ac2-436f-849d-52f74209c0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:01.052407 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-783ac80d-0ac2-436f-849d-52f74209c0e8 None None] MFA Rules not processed for user `2fdc40412a394820950c115b86a506a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:01.053628 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-783ac80d-0ac2-436f-849d-52f74209c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:01.116686 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1409/2805] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:01.127123 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:01.129621 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:01.184151 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f308113-455f-49f7-9c64-5ab2e847102c admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:01.187892 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caec4f-6afe-4149-ab90-591275678e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:01.188529 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caec4f-6afe-4149-ab90-591275678e22 service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:01.188812 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caec4f-6afe-4149-ab90-591275678e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:01.189089 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caec4f-6afe-4149-ab90-591275678e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:01.198196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0caec4f-6afe-4149-ab90-591275678e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:01.199622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0caec4f-6afe-4149-ab90-591275678e22 service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:01.208800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1397/2806] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:50:01.704517 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ac80d-0ac2-436f-849d-52f74209c0e8 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:01.763248 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ac80d-0ac2-436f-849d-52f74209c0e8 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:01.767718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:01.768578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:01.768864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:01.769660 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] PATH_INFO: `/v3/users/8368487b38844ca89ec786c86d3e971e` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:01.770836 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8368487b38844ca89ec786c86d3e971e)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:01.772737 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:01.816777 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8368487b38844ca89ec786c86d3e971e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:01.828219 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8368487b38844ca89ec786c86d3e971e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:01.835384 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8368487b38844ca89ec786c86d3e971e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:01.836028 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8368487b38844ca89ec786c86d3e971e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:01.842348 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8368487b38844ca89ec786c86d3e971e'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:01.848679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1410/2807] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:50:01 2022] DELETE /identity/v3/users/8368487b38844ca89ec786c86d3e971e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:50:01.853138 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a73cb-7772-4594-95b4-15736a810d7c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:01.853455 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a73cb-7772-4594-95b4-15736a810d7c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:01.853777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a73cb-7772-4594-95b4-15736a810d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:01.870916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-419a73cb-7772-4594-95b4-15736a810d7c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:01.872098 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-419a73cb-7772-4594-95b4-15736a810d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:01.929061 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1398/2808] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 07:50:01.938824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:01.940223 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:01.995362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148e613-1074-40f7-83ab-a8c213670930 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:01.999233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed267b5-4a83-49ef-a3cc-54858fe6f0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:01.999873 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed267b5-4a83-49ef-a3cc-54858fe6f0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:02.000155 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed267b5-4a83-49ef-a3cc-54858fe6f0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:02.000426 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed267b5-4a83-49ef-a3cc-54858fe6f0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:02.009480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed267b5-4a83-49ef-a3cc-54858fe6f0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:02.010921 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed267b5-4a83-49ef-a3cc-54858fe6f0b3 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:02.020080 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1411/2809] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:50:02.280772 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a73cb-7772-4594-95b4-15736a810d7c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:02.282764 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-419a73cb-7772-4594-95b4-15736a810d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:02.296337 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a73cb-7772-4594-95b4-15736a810d7c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:02.301343 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:02.302386 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:02.302728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:02.302961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] PATH_INFO: `/v3/projects/319c6dbbf0b24eddb1831e9d34ff4c32` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:02.304171 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319c6dbbf0b24eddb1831e9d34ff4c32)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:02.306116 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:02.351305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319c6dbbf0b24eddb1831e9d34ff4c32', 'request_id': 'req-188608c8-0559-43f9-b4f5-69e1270647a4'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.356480 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319c6dbbf0b24eddb1831e9d34ff4c32', 'request_id': 'req-188608c8-0559-43f9-b4f5-69e1270647a4'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.363214 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319c6dbbf0b24eddb1831e9d34ff4c32', 'request_id': 'req-188608c8-0559-43f9-b4f5-69e1270647a4'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.373622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] The token cache is being invalidate because project 319c6dbbf0b24eddb1831e9d34ff4c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:50:02.373909 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.374540 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.376039 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1399/2810] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:50:02 2022] DELETE /identity/v3/projects/319c6dbbf0b24eddb1831e9d34ff4c32 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:02.379948 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed267b5-4a83-49ef-a3cc-54858fe6f0b3 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:02.389212 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed267b5-4a83-49ef-a3cc-54858fe6f0b3 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:02.444668 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:02.445579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:02.445868 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:02.446143 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] PATH_INFO: `/v3/users/2fdc40412a394820950c115b86a506a0` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:02.447301 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fdc40412a394820950c115b86a506a0)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:02.449195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:02.494241 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fdc40412a394820950c115b86a506a0'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.505763 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fdc40412a394820950c115b86a506a0'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.512394 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fdc40412a394820950c115b86a506a0'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.513105 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fdc40412a394820950c115b86a506a0'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.520984 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fe153748-52ea-4ff2-a4dc-721bf3f553c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fdc40412a394820950c115b86a506a0'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.526959 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1412/2811] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:50:02 2022] DELETE /identity/v3/users/2fdc40412a394820950c115b86a506a0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:02.780938 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:02.782545 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:02.795728 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188608c8-0559-43f9-b4f5-69e1270647a4 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:02.850836 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:02.851687 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:02.851966 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:02.852241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] PATH_INFO: `/v3/projects/eb0c581d51fd4155bf7452fda38a0d5a` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:02.853403 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0c581d51fd4155bf7452fda38a0d5a)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:02.855306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:02.899709 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0c581d51fd4155bf7452fda38a0d5a', 'request_id': 'req-427d20a7-3d01-4248-b8f5-a0d57401d4ff'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.904796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0c581d51fd4155bf7452fda38a0d5a', 'request_id': 'req-427d20a7-3d01-4248-b8f5-a0d57401d4ff'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.911511 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0c581d51fd4155bf7452fda38a0d5a', 'request_id': 'req-427d20a7-3d01-4248-b8f5-a0d57401d4ff'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.921981 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] The token cache is being invalidate because project eb0c581d51fd4155bf7452fda38a0d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79913) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:50:02.922261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.922916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-427d20a7-3d01-4248-b8f5-a0d57401d4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:02.924452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1400/2812] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:50:02 2022] DELETE /identity/v3/projects/eb0c581d51fd4155bf7452fda38a0d5a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:02.929453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62377658-5c55-4a0a-ad7e-2d8ca2901378 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:02.929768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62377658-5c55-4a0a-ad7e-2d8ca2901378 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:02.930043 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62377658-5c55-4a0a-ad7e-2d8ca2901378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:02.948318 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-62377658-5c55-4a0a-ad7e-2d8ca2901378 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:02.949518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-62377658-5c55-4a0a-ad7e-2d8ca2901378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:03.008420 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1413/2813] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:03.016265 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa42f-b33b-4506-9acf-636cd186c4fa None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.016561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa42f-b33b-4506-9acf-636cd186c4fa None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.016844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fa42f-b33b-4506-9acf-636cd186c4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.035411 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-aa2fa42f-b33b-4506-9acf-636cd186c4fa None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:03.036551 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-aa2fa42f-b33b-4506-9acf-636cd186c4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:03.044315 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1401/2814] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:03.048255 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62377658-5c55-4a0a-ad7e-2d8ca2901378 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.058017 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62377658-5c55-4a0a-ad7e-2d8ca2901378 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.062466 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.063101 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.063381 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.063653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] PATH_INFO: `/v3/domains` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.064362 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:50:03.064665 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.066943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.078161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1414/2815] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 07:50:03.082273 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fa42f-b33b-4506-9acf-636cd186c4fa None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.091241 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fa42f-b33b-4506-9acf-636cd186c4fa None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.096057 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5804cc-b3f7-47ee-8378-b9c9bb458fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.096702 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5804cc-b3f7-47ee-8378-b9c9bb458fbd admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.096986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5804cc-b3f7-47ee-8378-b9c9bb458fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.097288 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5804cc-b3f7-47ee-8378-b9c9bb458fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.098030 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5804cc-b3f7-47ee-8378-b9c9bb458fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.099915 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5804cc-b3f7-47ee-8378-b9c9bb458fbd admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.124604 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1402/2816] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:03.128477 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.138678 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bf852-4013-47f8-8dfb-761a4d71345e admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.192510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b5ef7-0906-4ac3-b0fe-d3500a1e2914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.193196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b5ef7-0906-4ac3-b0fe-d3500a1e2914 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.193475 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b5ef7-0906-4ac3-b0fe-d3500a1e2914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.193792 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b5ef7-0906-4ac3-b0fe-d3500a1e2914 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.194480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b5ef7-0906-4ac3-b0fe-d3500a1e2914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.196429 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b5ef7-0906-4ac3-b0fe-d3500a1e2914 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.215560 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1415/2817] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:03.219550 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5804cc-b3f7-47ee-8378-b9c9bb458fbd admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.229410 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5804cc-b3f7-47ee-8378-b9c9bb458fbd admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.234054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c228-3e5e-4b5b-a1eb-76d9fb49899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.234701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c228-3e5e-4b5b-a1eb-76d9fb49899e admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.234984 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c228-3e5e-4b5b-a1eb-76d9fb49899e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.235257 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c228-3e5e-4b5b-a1eb-76d9fb49899e admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.235978 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3c228-3e5e-4b5b-a1eb-76d9fb49899e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.237670 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3c228-3e5e-4b5b-a1eb-76d9fb49899e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.248486 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1403/2818] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:03.253018 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b5ef7-0906-4ac3-b0fe-d3500a1e2914 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.263927 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b5ef7-0906-4ac3-b0fe-d3500a1e2914 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.268507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e4779-9c45-4ea6-995b-e68b4db54c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.269159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e4779-9c45-4ea6-995b-e68b4db54c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.269439 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e4779-9c45-4ea6-995b-e68b4db54c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.269738 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e4779-9c45-4ea6-995b-e68b4db54c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.270457 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e4779-9c45-4ea6-995b-e68b4db54c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.272062 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e4779-9c45-4ea6-995b-e68b4db54c51 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.281772 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1416/2819] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:03.286019 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c228-3e5e-4b5b-a1eb-76d9fb49899e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.295555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c228-3e5e-4b5b-a1eb-76d9fb49899e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.300041 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3152e-d211-4131-817e-8cb951dc08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.301405 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3152e-d211-4131-817e-8cb951dc08a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.301716 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3152e-d211-4131-817e-8cb951dc08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.301991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3152e-d211-4131-817e-8cb951dc08a5 admin admin] PATH_INFO: `/v3/projects/78cdc5daca714fe798e4aa60b2aee4d0/users/edbd8c731e9d40c295f17700b577f800/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.315912 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3152e-d211-4131-817e-8cb951dc08a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cdc5daca714fe798e4aa60b2aee4d0, user_id=edbd8c731e9d40c295f17700b577f800, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.319436 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3152e-d211-4131-817e-8cb951dc08a5 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.331775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1404/2820] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:03 2022] PUT /identity/v3/projects/78cdc5daca714fe798e4aa60b2aee4d0/users/edbd8c731e9d40c295f17700b577f800/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:03.341904 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1b805-1be7-441d-8183-eb3d0e1843b0 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.342190 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1b805-1be7-441d-8183-eb3d0e1843b0 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.342461 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1b805-1be7-441d-8183-eb3d0e1843b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.367862 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-e9b1b805-1be7-441d-8183-eb3d0e1843b0 None None] MFA Rules not processed for user `edbd8c731e9d40c295f17700b577f800`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:03.369040 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e9b1b805-1be7-441d-8183-eb3d0e1843b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:03.430150 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1417/2821] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:03.434541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3152e-d211-4131-817e-8cb951dc08a5 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.493694 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3152e-d211-4131-817e-8cb951dc08a5 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.498340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a624c-1880-4332-bd6b-1dec4c6a162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.498993 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a624c-1880-4332-bd6b-1dec4c6a162e admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.499279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a624c-1880-4332-bd6b-1dec4c6a162e admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.499555 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a624c-1880-4332-bd6b-1dec4c6a162e admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.500279 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a624c-1880-4332-bd6b-1dec4c6a162e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.502227 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a624c-1880-4332-bd6b-1dec4c6a162e admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.526301 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1405/2822] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:03.530320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1b805-1be7-441d-8183-eb3d0e1843b0 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.541148 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1b805-1be7-441d-8183-eb3d0e1843b0 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.593331 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb024d-8579-486a-876b-3a3be76ba26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.594009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb024d-8579-486a-876b-3a3be76ba26f admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.594288 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb024d-8579-486a-876b-3a3be76ba26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.594562 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb024d-8579-486a-876b-3a3be76ba26f admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.595233 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb024d-8579-486a-876b-3a3be76ba26f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.597125 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb024d-8579-486a-876b-3a3be76ba26f admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.617742 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1418/2823] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:50:03.621618 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a624c-1880-4332-bd6b-1dec4c6a162e admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.631678 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a624c-1880-4332-bd6b-1dec4c6a162e admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.636276 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf08c5-10af-48bf-9493-72df3fefbc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.636924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf08c5-10af-48bf-9493-72df3fefbc20 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.637210 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf08c5-10af-48bf-9493-72df3fefbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.637487 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf08c5-10af-48bf-9493-72df3fefbc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.638236 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf08c5-10af-48bf-9493-72df3fefbc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.639820 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf08c5-10af-48bf-9493-72df3fefbc20 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.651085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1406/2824] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 07:50:03.654819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb024d-8579-486a-876b-3a3be76ba26f admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.664729 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb024d-8579-486a-876b-3a3be76ba26f admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.669266 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32253f5a-f4bb-4ce0-87f3-191ae460d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.669945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253f5a-f4bb-4ce0-87f3-191ae460d2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.670228 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253f5a-f4bb-4ce0-87f3-191ae460d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.670502 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32253f5a-f4bb-4ce0-87f3-191ae460d2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.671259 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32253f5a-f4bb-4ce0-87f3-191ae460d2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.672833 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32253f5a-f4bb-4ce0-87f3-191ae460d2f7 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.682882 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1419/2825] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:03.686734 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf08c5-10af-48bf-9493-72df3fefbc20 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.696557 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf08c5-10af-48bf-9493-72df3fefbc20 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.701103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee36d9-818b-4708-b4d8-727a924f89d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.702015 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee36d9-818b-4708-b4d8-727a924f89d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.702299 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee36d9-818b-4708-b4d8-727a924f89d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.702573 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee36d9-818b-4708-b4d8-727a924f89d7 admin admin] PATH_INFO: `/v3/projects/2f849003f465422e83a644c836a6918d/users/6777d9f858ed46a2bd9eb0cefab4892f/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.716710 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee36d9-818b-4708-b4d8-727a924f89d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f849003f465422e83a644c836a6918d, user_id=6777d9f858ed46a2bd9eb0cefab4892f, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.720590 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee36d9-818b-4708-b4d8-727a924f89d7 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.733607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1407/2826] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:03 2022] PUT /identity/v3/projects/2f849003f465422e83a644c836a6918d/users/6777d9f858ed46a2bd9eb0cefab4892f/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:03.745452 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6f7a3-b168-4ddd-8b1e-3b82d8b5dfa8 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.745794 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6f7a3-b168-4ddd-8b1e-3b82d8b5dfa8 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.746076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6f7a3-b168-4ddd-8b1e-3b82d8b5dfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.771577 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-0fb6f7a3-b168-4ddd-8b1e-3b82d8b5dfa8 None None] MFA Rules not processed for user `6777d9f858ed46a2bd9eb0cefab4892f`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:03.772784 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-0fb6f7a3-b168-4ddd-8b1e-3b82d8b5dfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:03.833606 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1420/2827] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:03.838118 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee36d9-818b-4708-b4d8-727a924f89d7 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.896607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee36d9-818b-4708-b4d8-727a924f89d7 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:03.901182 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a3e1-d323-45bc-a19e-a5c9335e746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:03.901857 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a3e1-d323-45bc-a19e-a5c9335e746a admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:03.902142 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a3e1-d323-45bc-a19e-a5c9335e746a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:03.902424 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a3e1-d323-45bc-a19e-a5c9335e746a admin admin] PATH_INFO: `/v3/projects` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:03.903115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429a3e1-d323-45bc-a19e-a5c9335e746a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:03.904999 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429a3e1-d323-45bc-a19e-a5c9335e746a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:03.928851 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1408/2828] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:50:03.932774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6f7a3-b168-4ddd-8b1e-3b82d8b5dfa8 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:03.943346 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6f7a3-b168-4ddd-8b1e-3b82d8b5dfa8 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:04.001722 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21f67-bcff-400c-bc0a-6ebb273a29e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:04.002393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21f67-bcff-400c-bc0a-6ebb273a29e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:04.002679 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21f67-bcff-400c-bc0a-6ebb273a29e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:04.002955 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21f67-bcff-400c-bc0a-6ebb273a29e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:04.003639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d21f67-bcff-400c-bc0a-6ebb273a29e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:04.005594 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d21f67-bcff-400c-bc0a-6ebb273a29e5 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:04.024932 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1421/2829] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:50:03 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:04.029025 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a3e1-d323-45bc-a19e-a5c9335e746a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:04.039746 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a3e1-d323-45bc-a19e-a5c9335e746a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:04.044318 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6a7e5-653a-4262-be4c-1e9ee8dc12aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:04.044969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6a7e5-653a-4262-be4c-1e9ee8dc12aa admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:04.045253 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6a7e5-653a-4262-be4c-1e9ee8dc12aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:04.045531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6a7e5-653a-4262-be4c-1e9ee8dc12aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:04.046281 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6a7e5-653a-4262-be4c-1e9ee8dc12aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:04.047903 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6a7e5-653a-4262-be4c-1e9ee8dc12aa admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:04.058063 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1409/2830] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:04.061933 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21f67-bcff-400c-bc0a-6ebb273a29e5 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:04.071703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21f67-bcff-400c-bc0a-6ebb273a29e5 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:04.076303 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262c8bb-b5e1-449a-b434-fc7245a56e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:04.077169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c8bb-b5e1-449a-b434-fc7245a56e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:04.077451 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c8bb-b5e1-449a-b434-fc7245a56e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:04.077758 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262c8bb-b5e1-449a-b434-fc7245a56e24 admin admin] PATH_INFO: `/v3/projects/9655eda413b74bb0bf44fee2d87c61ea/users/4597b07482b544b39687e7f06e7ea02a/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:04.092516 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262c8bb-b5e1-449a-b434-fc7245a56e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9655eda413b74bb0bf44fee2d87c61ea, user_id=4597b07482b544b39687e7f06e7ea02a, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:04.095136 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262c8bb-b5e1-449a-b434-fc7245a56e24 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:04.108152 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1422/2831] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:04 2022] PUT /identity/v3/projects/9655eda413b74bb0bf44fee2d87c61ea/users/4597b07482b544b39687e7f06e7ea02a/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:04.111916 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6a7e5-653a-4262-be4c-1e9ee8dc12aa admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:04.121684 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6a7e5-653a-4262-be4c-1e9ee8dc12aa admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:04.175960 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1c065-3428-4bbf-b69d-9d410bd16479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:04.176637 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c065-3428-4bbf-b69d-9d410bd16479 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:04.176918 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c065-3428-4bbf-b69d-9d410bd16479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:04.177193 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c065-3428-4bbf-b69d-9d410bd16479 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:04.177948 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1c065-3428-4bbf-b69d-9d410bd16479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:04.179535 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1c065-3428-4bbf-b69d-9d410bd16479 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:04.189153 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1410/2832] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:04.193283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262c8bb-b5e1-449a-b434-fc7245a56e24 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:04.203133 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262c8bb-b5e1-449a-b434-fc7245a56e24 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:04.207653 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:04.208518 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:04.208798 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:04.209068 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] PATH_INFO: `/v3/projects/9655eda413b74bb0bf44fee2d87c61ea/users/4597b07482b544b39687e7f06e7ea02a/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:04.211044 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9655eda413b74bb0bf44fee2d87c61ea, user_id=4597b07482b544b39687e7f06e7ea02a, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:04.213697 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:04.224157 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1423/2833] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:04 2022] PUT /identity/v3/projects/9655eda413b74bb0bf44fee2d87c61ea/users/4597b07482b544b39687e7f06e7ea02a/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:04.234502 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01717-bd09-40ab-991a-9ad63119d254 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:04.234791 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01717-bd09-40ab-991a-9ad63119d254 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:04.235064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01717-bd09-40ab-991a-9ad63119d254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:04.262594 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-3ef01717-bd09-40ab-991a-9ad63119d254 None None] MFA Rules not processed for user `4597b07482b544b39687e7f06e7ea02a`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:04.263796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3ef01717-bd09-40ab-991a-9ad63119d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:04.328037 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1411/2834] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:04.339276 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:04.340949 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:04.395693 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154cfde-dfeb-4c9c-959d-4ce1d882e2b0 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:04.399188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851853b5-e89d-4d84-83f3-0c327db83aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:04.399810 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851853b5-e89d-4d84-83f3-0c327db83aba service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:04.400087 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851853b5-e89d-4d84-83f3-0c327db83aba service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:04.400358 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851853b5-e89d-4d84-83f3-0c327db83aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:04.457546 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851853b5-e89d-4d84-83f3-0c327db83aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:04.459007 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851853b5-e89d-4d84-83f3-0c327db83aba service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:04.467894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1424/2835] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:50:05.923581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef01717-bd09-40ab-991a-9ad63119d254 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:05.925096 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-3ef01717-bd09-40ab-991a-9ad63119d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:05.939789 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef01717-bd09-40ab-991a-9ad63119d254 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:05.944627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28a452-e755-46f4-a2ff-d1d3133af76a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:05.945268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28a452-e755-46f4-a2ff-d1d3133af76a service cinder] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:05.945570 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28a452-e755-46f4-a2ff-d1d3133af76a service cinder] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:05.945852 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28a452-e755-46f4-a2ff-d1d3133af76a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:06.000369 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28a452-e755-46f4-a2ff-d1d3133af76a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:06.001808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28a452-e755-46f4-a2ff-d1d3133af76a service cinder] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:06.010976 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1412/2836] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:50:06.505706 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851853b5-e89d-4d84-83f3-0c327db83aba service cinder] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:06.514075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851853b5-e89d-4d84-83f3-0c327db83aba service cinder] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:06.517767 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5dc10-6651-4cf0-8a8c-9d91551330d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:06.518342 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5dc10-6651-4cf0-8a8c-9d91551330d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:06.518624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5dc10-6651-4cf0-8a8c-9d91551330d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:06.518900 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5dc10-6651-4cf0-8a8c-9d91551330d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:06.527498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5dc10-6651-4cf0-8a8c-9d91551330d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:06.528943 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5dc10-6651-4cf0-8a8c-9d91551330d4 service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:06.538752 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1425/2837] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:50:10.350305 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28a452-e755-46f4-a2ff-d1d3133af76a service cinder] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:10.409751 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28a452-e755-46f4-a2ff-d1d3133af76a service cinder] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:10.414639 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:10.415490 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:10.415771 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:10.416043 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] PATH_INFO: `/v3/users/edbd8c731e9d40c295f17700b577f800` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:10.417196 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbd8c731e9d40c295f17700b577f800)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:10.419111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:10.467717 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbd8c731e9d40c295f17700b577f800'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:10.479560 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbd8c731e9d40c295f17700b577f800'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:10.480226 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbd8c731e9d40c295f17700b577f800'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:10.486971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbd8c731e9d40c295f17700b577f800'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:10.487612 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbd8c731e9d40c295f17700b577f800'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:10.500815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1413/2838] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:50:10 2022] DELETE /identity/v3/users/edbd8c731e9d40c295f17700b577f800 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:10.505237 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b634-83a5-4f7a-bd6e-3eebef565a66 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:10.505730 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b634-83a5-4f7a-bd6e-3eebef565a66 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:10.505875 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241b634-83a5-4f7a-bd6e-3eebef565a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:10.523446 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-4241b634-83a5-4f7a-bd6e-3eebef565a66 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:10.524644 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4241b634-83a5-4f7a-bd6e-3eebef565a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:10.580619 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1426/2839] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:10.590420 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:10.591796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:10.646879 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacbc4-fa4b-450f-a026-b6a0267c3ef0 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:10.650521 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8df825-f616-43ee-b362-35557942b87a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:10.651164 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df825-f616-43ee-b362-35557942b87a service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:10.651448 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df825-f616-43ee-b362-35557942b87a service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:10.651727 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8df825-f616-43ee-b362-35557942b87a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:10.661071 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8df825-f616-43ee-b362-35557942b87a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:10.662542 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8df825-f616-43ee-b362-35557942b87a service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:10.671924 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1414/2840] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:50:10.930924 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241b634-83a5-4f7a-bd6e-3eebef565a66 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:10.932417 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4241b634-83a5-4f7a-bd6e-3eebef565a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:10.946460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241b634-83a5-4f7a-bd6e-3eebef565a66 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:10.951473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:10.952779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:10.953066 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:10.953341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] PATH_INFO: `/v3/projects/78cdc5daca714fe798e4aa60b2aee4d0` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:10.954569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cdc5daca714fe798e4aa60b2aee4d0)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:10.956841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:11.001893 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cdc5daca714fe798e4aa60b2aee4d0', 'request_id': 'req-479f6f89-d17c-482b-bed7-2f6c48e01534'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.007718 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cdc5daca714fe798e4aa60b2aee4d0', 'request_id': 'req-479f6f89-d17c-482b-bed7-2f6c48e01534'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.014689 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cdc5daca714fe798e4aa60b2aee4d0', 'request_id': 'req-479f6f89-d17c-482b-bed7-2f6c48e01534'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.029247 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] The token cache is being invalidate because project 78cdc5daca714fe798e4aa60b2aee4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:50:11.029530 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.030175 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.031682 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1427/2841] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:50:10 2022] DELETE /identity/v3/projects/78cdc5daca714fe798e4aa60b2aee4d0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:11.035693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8df825-f616-43ee-b362-35557942b87a service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:11.045082 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8df825-f616-43ee-b362-35557942b87a service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:11.098569 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:11.099432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:11.099714 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:11.099989 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] PATH_INFO: `/v3/users/6777d9f858ed46a2bd9eb0cefab4892f` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:11.101155 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6777d9f858ed46a2bd9eb0cefab4892f)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:11.103097 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:11.147580 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6777d9f858ed46a2bd9eb0cefab4892f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.158660 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6777d9f858ed46a2bd9eb0cefab4892f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.159313 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6777d9f858ed46a2bd9eb0cefab4892f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.165783 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6777d9f858ed46a2bd9eb0cefab4892f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.166404 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6777d9f858ed46a2bd9eb0cefab4892f'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.178127 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1415/2842] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:50:11 2022] DELETE /identity/v3/users/6777d9f858ed46a2bd9eb0cefab4892f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:11.440624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:11.442999 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:11.462137 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f6f89-d17c-482b-bed7-2f6c48e01534 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:11.517180 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:11.518075 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:11.518359 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:11.518639 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] PATH_INFO: `/v3/projects/2f849003f465422e83a644c836a6918d` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:11.519968 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f849003f465422e83a644c836a6918d)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:11.522006 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:11.565547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f849003f465422e83a644c836a6918d', 'request_id': 'req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.571507 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f849003f465422e83a644c836a6918d', 'request_id': 'req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.578389 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f849003f465422e83a644c836a6918d', 'request_id': 'req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.589052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] The token cache is being invalidate because project 2f849003f465422e83a644c836a6918d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:50:11.589340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.590053 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.591556 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1428/2843] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:50:11 2022] DELETE /identity/v3/projects/2f849003f465422e83a644c836a6918d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:11.595566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:11.596943 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:11.609062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe34f8-d72f-40e2-8393-a861b2fc0ebd admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:11.663115 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:11.663986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:11.664268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:11.664541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] PATH_INFO: `/v3/users/4597b07482b544b39687e7f06e7ea02a` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:11.665798 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4597b07482b544b39687e7f06e7ea02a)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:11.667707 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:11.713866 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4597b07482b544b39687e7f06e7ea02a'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.725597 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4597b07482b544b39687e7f06e7ea02a'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.726268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4597b07482b544b39687e7f06e7ea02a'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.732719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4597b07482b544b39687e7f06e7ea02a'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.733342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-dc443da7-e130-4d26-a9ff-0162c916e7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4597b07482b544b39687e7f06e7ea02a'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:11.746719 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1416/2844] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:50:11 2022] DELETE /identity/v3/users/4597b07482b544b39687e7f06e7ea02a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:12.000651 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:12.002106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:12.015299 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba671c8-fdfa-43c8-b8bb-45cb1e706218 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:12.070985 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:12.071841 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.072124 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.072398 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] PATH_INFO: `/v3/projects/9655eda413b74bb0bf44fee2d87c61ea` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.073579 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9655eda413b74bb0bf44fee2d87c61ea)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:12.075460 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:12.122165 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9655eda413b74bb0bf44fee2d87c61ea', 'request_id': 'req-af401e1d-89a1-4d0d-b77c-f36eed3434fd'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:12.127819 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9655eda413b74bb0bf44fee2d87c61ea', 'request_id': 'req-af401e1d-89a1-4d0d-b77c-f36eed3434fd'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:12.134564 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9655eda413b74bb0bf44fee2d87c61ea', 'request_id': 'req-af401e1d-89a1-4d0d-b77c-f36eed3434fd'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:12.145715 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] The token cache is being invalidate because project 9655eda413b74bb0bf44fee2d87c61ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:50:12.146002 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:12.146629 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-af401e1d-89a1-4d0d-b77c-f36eed3434fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:12.148164 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1429/2845] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:50:11 2022] DELETE /identity/v3/projects/9655eda413b74bb0bf44fee2d87c61ea => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:12.152970 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412c5a-5a3d-417d-8949-8d71319983a4 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.153254 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412c5a-5a3d-417d-8949-8d71319983a4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.153531 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412c5a-5a3d-417d-8949-8d71319983a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.170997 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-0e412c5a-5a3d-417d-8949-8d71319983a4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:12.172212 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-0e412c5a-5a3d-417d-8949-8d71319983a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:12.228563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1417/2846] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:12.287310 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978fa82-f89f-4304-b811-575d703c4a17 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.287547 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978fa82-f89f-4304-b811-575d703c4a17 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.287774 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978fa82-f89f-4304-b811-575d703c4a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.306608 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-8978fa82-f89f-4304-b811-575d703c4a17 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:12.307803 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-8978fa82-f89f-4304-b811-575d703c4a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:12.315585 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1430/2847] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:12.319998 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412c5a-5a3d-417d-8949-8d71319983a4 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:12.329390 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412c5a-5a3d-417d-8949-8d71319983a4 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:12.334452 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:12.335094 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.335381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.335644 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.336366 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:50:12.336668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:12.338284 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:12.349844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1418/2848] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:50:12.353805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978fa82-f89f-4304-b811-575d703c4a17 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:12.362510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978fa82-f89f-4304-b811-575d703c4a17 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:12.367118 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9528518-32e5-409e-9241-9d1b7bf8698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:12.367747 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528518-32e5-409e-9241-9d1b7bf8698b admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.368024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528518-32e5-409e-9241-9d1b7bf8698b admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.368296 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528518-32e5-409e-9241-9d1b7bf8698b admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.368969 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9528518-32e5-409e-9241-9d1b7bf8698b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:12.370860 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9528518-32e5-409e-9241-9d1b7bf8698b admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:12.395393 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1431/2849] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:50:12 2022] POST /identity/v3/projects => generated 363 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:12.399328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:12.408800 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb473d8-4845-4909-b9b9-4a8d941c9bfd admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:12.465574 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29872be6-e5c0-4284-a859-09677ab8bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:12.466244 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872be6-e5c0-4284-a859-09677ab8bd82 admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.466530 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872be6-e5c0-4284-a859-09677ab8bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.466805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872be6-e5c0-4284-a859-09677ab8bd82 admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.467505 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29872be6-e5c0-4284-a859-09677ab8bd82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:12.469414 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29872be6-e5c0-4284-a859-09677ab8bd82 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:12.489263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1419/2850] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:50:12 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:50:12.493655 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9528518-32e5-409e-9241-9d1b7bf8698b admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:12.503555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9528518-32e5-409e-9241-9d1b7bf8698b admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:12.508544 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68e685-15fe-46dc-bdc6-e8cc68a69600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:12.509185 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e685-15fe-46dc-bdc6-e8cc68a69600 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.509462 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e685-15fe-46dc-bdc6-e8cc68a69600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.509769 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e685-15fe-46dc-bdc6-e8cc68a69600 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.510480 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68e685-15fe-46dc-bdc6-e8cc68a69600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:12.512064 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68e685-15fe-46dc-bdc6-e8cc68a69600 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:12.522826 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1432/2851] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:12.526519 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29872be6-e5c0-4284-a859-09677ab8bd82 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:12.536599 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29872be6-e5c0-4284-a859-09677ab8bd82 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:12.541192 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed913f97-a3d4-4be1-b3bb-f6b5f0df4bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:12.541805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed913f97-a3d4-4be1-b3bb-f6b5f0df4bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.542087 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed913f97-a3d4-4be1-b3bb-f6b5f0df4bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.542361 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed913f97-a3d4-4be1-b3bb-f6b5f0df4bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.543113 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed913f97-a3d4-4be1-b3bb-f6b5f0df4bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:12.544692 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed913f97-a3d4-4be1-b3bb-f6b5f0df4bbc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:12.554303 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1420/2852] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:12.558314 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68e685-15fe-46dc-bdc6-e8cc68a69600 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:12.568829 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68e685-15fe-46dc-bdc6-e8cc68a69600 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:12.573496 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:12.574423 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.574701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.574974 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] PATH_INFO: `/v3/projects/e89193a41c654822acf4ad44c5b1fe81/users/62da43cd1a6f49e59519f08d12b88712/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.589624 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89193a41c654822acf4ad44c5b1fe81, user_id=62da43cd1a6f49e59519f08d12b88712, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:12.592254 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:12.605207 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1433/2853] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:12 2022] PUT /identity/v3/projects/e89193a41c654822acf4ad44c5b1fe81/users/62da43cd1a6f49e59519f08d12b88712/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:12.614961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e34f-a262-4f9a-aab0-070bef7fc431 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.615458 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e34f-a262-4f9a-aab0-070bef7fc431 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.615563 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e34f-a262-4f9a-aab0-070bef7fc431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.641489 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-c237e34f-a262-4f9a-aab0-070bef7fc431 None None] MFA Rules not processed for user `62da43cd1a6f49e59519f08d12b88712`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:12.642715 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-c237e34f-a262-4f9a-aab0-070bef7fc431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:12.705050 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1421/2854] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:12.716991 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:12.718701 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:12.772979 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d343-6d7a-405f-984e-8579dff4bc26 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:12.776553 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58eed47-836a-48b1-9827-9c63f1c2f05f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '529651ab9dd74ee1b50382d03800aea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:12.777182 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed47-836a-48b1-9827-9c63f1c2f05f service cinder] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:12.777470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed47-836a-48b1-9827-9c63f1c2f05f service cinder] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:12.777762 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58eed47-836a-48b1-9827-9c63f1c2f05f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:12.785748 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eed47-836a-48b1-9827-9c63f1c2f05f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:12.787160 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58eed47-836a-48b1-9827-9c63f1c2f05f service cinder] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:12.795703 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1434/2855] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:50:48.386796 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237e34f-a262-4f9a-aab0-070bef7fc431 None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:48.461874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237e34f-a262-4f9a-aab0-070bef7fc431 None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:48.466418 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:48.467291 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:48.467607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:48.467887 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] PATH_INFO: `/v3/users/62da43cd1a6f49e59519f08d12b88712` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:48.469085 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62da43cd1a6f49e59519f08d12b88712)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:48.471064 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:48.515344 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62da43cd1a6f49e59519f08d12b88712'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:48.527137 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62da43cd1a6f49e59519f08d12b88712'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:48.527822 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62da43cd1a6f49e59519f08d12b88712'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:48.535325 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62da43cd1a6f49e59519f08d12b88712'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:48.535964 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62da43cd1a6f49e59519f08d12b88712'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:48.548838 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1422/2856] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:50:48 2022] DELETE /identity/v3/users/62da43cd1a6f49e59519f08d12b88712 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:48.553323 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec419c9c-843c-4f10-ae3e-8d41d2dab0da None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:48.553853 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec419c9c-843c-4f10-ae3e-8d41d2dab0da None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:48.553981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec419c9c-843c-4f10-ae3e-8d41d2dab0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:48.580896 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-ec419c9c-843c-4f10-ae3e-8d41d2dab0da None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:48.582119 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ec419c9c-843c-4f10-ae3e-8d41d2dab0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:48.637971 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1435/2857] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:48.647472 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:48.649399 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:48.704345 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb20c95-b3b0-48f7-b295-a4bf5b26e7f7 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:48.707980 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74b2a8-e8b6-4383-beb8-587e312df41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:48.708617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74b2a8-e8b6-4383-beb8-587e312df41f service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:48.708900 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74b2a8-e8b6-4383-beb8-587e312df41f service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:48.709178 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74b2a8-e8b6-4383-beb8-587e312df41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:48.718354 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74b2a8-e8b6-4383-beb8-587e312df41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:48.719786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74b2a8-e8b6-4383-beb8-587e312df41f service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:48.729506 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1423/2858] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:50:48.985377 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec419c9c-843c-4f10-ae3e-8d41d2dab0da None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:48.986945 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-ec419c9c-843c-4f10-ae3e-8d41d2dab0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:49.000494 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec419c9c-843c-4f10-ae3e-8d41d2dab0da None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:49.006058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:49.006830 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.007116 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.008578 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] PATH_INFO: `/v3/projects/e89193a41c654822acf4ad44c5b1fe81` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.009918 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89193a41c654822acf4ad44c5b1fe81)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:49.011840 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:49.058169 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89193a41c654822acf4ad44c5b1fe81', 'request_id': 'req-fc70d2ad-3282-4638-aa8f-394d4c47efe9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:49.063551 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89193a41c654822acf4ad44c5b1fe81', 'request_id': 'req-fc70d2ad-3282-4638-aa8f-394d4c47efe9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:49.071189 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89193a41c654822acf4ad44c5b1fe81', 'request_id': 'req-fc70d2ad-3282-4638-aa8f-394d4c47efe9'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:49.081795 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] The token cache is being invalidate because project e89193a41c654822acf4ad44c5b1fe81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:50:49.082083 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:49.082695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-fc70d2ad-3282-4638-aa8f-394d4c47efe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:50:49.084209 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1436/2859] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:50:48 2022] DELETE /identity/v3/projects/e89193a41c654822acf4ad44c5b1fe81 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:49.089745 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d2be-b20a-4c03-bbc1-43c296822d5c None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.090031 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d2be-b20a-4c03-bbc1-43c296822d5c None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.090306 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704d2be-b20a-4c03-bbc1-43c296822d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.106958 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8704d2be-b20a-4c03-bbc1-43c296822d5c None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:49.108130 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8704d2be-b20a-4c03-bbc1-43c296822d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:49.163622 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1424/2860] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:49.172360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fc28-4958-4bc1-9215-2d1ccf4ca30e None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.172672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fc28-4958-4bc1-9215-2d1ccf4ca30e None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.172951 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11fc28-4958-4bc1-9215-2d1ccf4ca30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.190849 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-4c11fc28-4958-4bc1-9215-2d1ccf4ca30e None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:49.192027 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-4c11fc28-4958-4bc1-9215-2d1ccf4ca30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:49.200470 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1437/2861] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:49.204461 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704d2be-b20a-4c03-bbc1-43c296822d5c None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:49.214482 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704d2be-b20a-4c03-bbc1-43c296822d5c None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:49.218961 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:49.219600 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.219882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.220157 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.220868 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79913) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 07:50:49.221174 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:49.222844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:49.233921 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1425/2862] 10.222.0.36 () {58 vars in 1152 bytes} [Wed May 11 07:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 07:50:49.238060 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11fc28-4958-4bc1-9215-2d1ccf4ca30e None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:49.247340 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11fc28-4958-4bc1-9215-2d1ccf4ca30e None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:49.252176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1e9d-7465-47e1-8334-00b67a7ad667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:49.252824 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1e9d-7465-47e1-8334-00b67a7ad667 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.253106 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1e9d-7465-47e1-8334-00b67a7ad667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.253382 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b1e9d-7465-47e1-8334-00b67a7ad667 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.254221 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1e9d-7465-47e1-8334-00b67a7ad667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:49.256204 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b1e9d-7465-47e1-8334-00b67a7ad667 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:49.281751 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1438/2863] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:50:49 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:49.285432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:49.295128 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54473b4e-12b6-47be-b943-3f08ed3cfde3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:49.348722 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322243c-c1af-4043-9791-5b79b9da6c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:49.349374 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322243c-c1af-4043-9791-5b79b9da6c5b admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.349696 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322243c-c1af-4043-9791-5b79b9da6c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.349971 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322243c-c1af-4043-9791-5b79b9da6c5b admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.350651 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322243c-c1af-4043-9791-5b79b9da6c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:49.353073 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322243c-c1af-4043-9791-5b79b9da6c5b admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:49.372342 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1426/2864] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:50:49 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:49.376625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1e9d-7465-47e1-8334-00b67a7ad667 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:49.386768 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b1e9d-7465-47e1-8334-00b67a7ad667 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:49.391351 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2091-7ab4-429c-a362-46996a133dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:49.392003 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2091-7ab4-429c-a362-46996a133dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.392289 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2091-7ab4-429c-a362-46996a133dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.392570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2091-7ab4-429c-a362-46996a133dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.393290 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2091-7ab4-429c-a362-46996a133dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:49.394922 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2091-7ab4-429c-a362-46996a133dc3 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:49.405372 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1439/2865] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:49.409110 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322243c-c1af-4043-9791-5b79b9da6c5b admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:49.419649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322243c-c1af-4043-9791-5b79b9da6c5b admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:49.424207 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a0e28-948c-43c1-9c31-dfab7d9df9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:49.424855 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0e28-948c-43c1-9c31-dfab7d9df9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.425277 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0e28-948c-43c1-9c31-dfab7d9df9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.425578 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0e28-948c-43c1-9c31-dfab7d9df9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.426328 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a0e28-948c-43c1-9c31-dfab7d9df9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:49.427910 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a0e28-948c-43c1-9c31-dfab7d9df9e2 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:49.439353 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1427/2866] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:49.443403 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2091-7ab4-429c-a362-46996a133dc3 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:49.452964 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2091-7ab4-429c-a362-46996a133dc3 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:49.457506 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:49.458430 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.458707 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.458977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] PATH_INFO: `/v3/projects/919cd09d224147718daec2e2203980f6/users/cb4b533b8bbe4cbabf2780c82f04e44d/roles/e6b936a5820f443fb9310f7cdfe7a1f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.473514 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919cd09d224147718daec2e2203980f6, user_id=cb4b533b8bbe4cbabf2780c82f04e44d, role_id=e6b936a5820f443fb9310f7cdfe7a1f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:49.476181 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:49.488953 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1440/2867] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:49 2022] PUT /identity/v3/projects/919cd09d224147718daec2e2203980f6/users/cb4b533b8bbe4cbabf2780c82f04e44d/roles/e6b936a5820f443fb9310f7cdfe7a1f6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:49.494016 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874a55-dad7-445a-ba19-58c8c3e53ed4 None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.494302 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874a55-dad7-445a-ba19-58c8c3e53ed4 None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.494577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7874a55-dad7-445a-ba19-58c8c3e53ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.510810 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-a7874a55-dad7-445a-ba19-58c8c3e53ed4 None None] MFA Rules not processed for user `2752110942d445b6bd51fbda49f0d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:49.511985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a7874a55-dad7-445a-ba19-58c8c3e53ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:49.566701 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1428/2868] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:49.576699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:49.578419 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:49.632568 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e441d6e-a52f-4ef0-9661-794cfcba9fa9 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:49.636076 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b527a-2548-4524-9dd5-02a9d6753f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:49.636708 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b527a-2548-4524-9dd5-02a9d6753f1b service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:49.636988 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b527a-2548-4524-9dd5-02a9d6753f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:49.637260 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b527a-2548-4524-9dd5-02a9d6753f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:49.646016 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b527a-2548-4524-9dd5-02a9d6753f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:49.647438 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b527a-2548-4524-9dd5-02a9d6753f1b service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:49.656977 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1441/2869] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:50:53.634391 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a6ad-87fc-4a94-801d-d79c48b8722a None None] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:53.634873 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a6ad-87fc-4a94-801d-d79c48b8722a None None] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:53.634969 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000a6ad-87fc-4a94-801d-d79c48b8722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:53.684625 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.auth.core [None req-8000a6ad-87fc-4a94-801d-d79c48b8722a None None] MFA Rules not processed for user `cb4b533b8bbe4cbabf2780c82f04e44d`. Rule list: `[]` (Enabled: `True`). {{(pid=79913) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:53.685979 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-8000a6ad-87fc-4a94-801d-d79c48b8722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:53.768742 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1429/2870] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:53.769981 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b527a-2548-4524-9dd5-02a9d6753f1b service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:53.788161 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b527a-2548-4524-9dd5-02a9d6753f1b service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:53.795590 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567d07-f968-4fcc-9e5e-79dd79fca5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:53.796283 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567d07-f968-4fcc-9e5e-79dd79fca5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:53.796569 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567d07-f968-4fcc-9e5e-79dd79fca5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:53.796846 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f567d07-f968-4fcc-9e5e-79dd79fca5c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:53.797570 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f567d07-f968-4fcc-9e5e-79dd79fca5c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:53.799889 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f567d07-f968-4fcc-9e5e-79dd79fca5c3 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:53.838673 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1442/2871] 10.222.0.36 () {60 vars in 1152 bytes} [Wed May 11 07:50:53 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 07:50:53.839817 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000a6ad-87fc-4a94-801d-d79c48b8722a None None] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:53.851088 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000a6ad-87fc-4a94-801d-d79c48b8722a None None] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:53.918927 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b0c96-ee26-43b7-977b-50e880aa2d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:53.919611 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b0c96-ee26-43b7-977b-50e880aa2d4a admin admin] REQUEST_METHOD: `POST` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:53.919897 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b0c96-ee26-43b7-977b-50e880aa2d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:53.920176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b0c96-ee26-43b7-977b-50e880aa2d4a admin admin] PATH_INFO: `/v3/users` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:53.920883 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b0c96-ee26-43b7-977b-50e880aa2d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:53.922861 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b0c96-ee26-43b7-977b-50e880aa2d4a admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:53.943513 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1430/2872] 10.222.0.36 () {60 vars in 1143 bytes} [Wed May 11 07:50:53 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 07:50:53.947501 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567d07-f968-4fcc-9e5e-79dd79fca5c3 admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:53.968613 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f567d07-f968-4fcc-9e5e-79dd79fca5c3 admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:53.974490 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baca4e-ddad-4386-9e1c-7615a34a4d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:53.975413 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baca4e-ddad-4386-9e1c-7615a34a4d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:53.975907 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baca4e-ddad-4386-9e1c-7615a34a4d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:53.976433 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baca4e-ddad-4386-9e1c-7615a34a4d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:53.977790 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baca4e-ddad-4386-9e1c-7615a34a4d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:53.979625 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baca4e-ddad-4386-9e1c-7615a34a4d1d admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:53.990532 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1443/2873] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:53.994792 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b0c96-ee26-43b7-977b-50e880aa2d4a admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:54.015841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b0c96-ee26-43b7-977b-50e880aa2d4a admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:54.020619 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9760-97d4-4631-94ba-805450f657b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:54.021512 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9760-97d4-4631-94ba-805450f657b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:54.021830 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9760-97d4-4631-94ba-805450f657b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:54.022109 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9760-97d4-4631-94ba-805450f657b3 admin admin] PATH_INFO: `/v3/projects/48425808a52544e98f655143603d4050/users/948a88ed2dd24b45b3107cc0671fd43e/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:54.037387 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a9760-97d4-4631-94ba-805450f657b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48425808a52544e98f655143603d4050, user_id=948a88ed2dd24b45b3107cc0671fd43e, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:54.040787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a9760-97d4-4631-94ba-805450f657b3 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:54.055748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1431/2874] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:53 2022] PUT /identity/v3/projects/48425808a52544e98f655143603d4050/users/948a88ed2dd24b45b3107cc0671fd43e/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:54.059618 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baca4e-ddad-4386-9e1c-7615a34a4d1d admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:54.071647 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baca4e-ddad-4386-9e1c-7615a34a4d1d admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:54.146806 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46843873-df01-4190-a2df-b349b94e4a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:54.147493 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46843873-df01-4190-a2df-b349b94e4a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:54.147779 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46843873-df01-4190-a2df-b349b94e4a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:54.148052 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46843873-df01-4190-a2df-b349b94e4a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:54.148820 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46843873-df01-4190-a2df-b349b94e4a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:54.150650 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46843873-df01-4190-a2df-b349b94e4a01 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:54.163858 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1444/2875] 10.222.0.36 () {58 vars in 1121 bytes} [Wed May 11 07:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 07:50:54.168079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9760-97d4-4631-94ba-805450f657b3 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:54.178642 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9760-97d4-4631-94ba-805450f657b3 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:54.183889 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:54.184787 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:54.185103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:54.185381 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] PATH_INFO: `/v3/projects/48425808a52544e98f655143603d4050/users/948a88ed2dd24b45b3107cc0671fd43e/roles/de114c58fdc8476ebab657e6f9359155` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:54.187514 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=48425808a52544e98f655143603d4050, user_id=948a88ed2dd24b45b3107cc0671fd43e, role_id=de114c58fdc8476ebab657e6f9359155)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:54.190255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:54.214844 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1432/2876] 10.222.0.36 () {60 vars in 1482 bytes} [Wed May 11 07:50:54 2022] PUT /identity/v3/projects/48425808a52544e98f655143603d4050/users/948a88ed2dd24b45b3107cc0671fd43e/roles/de114c58fdc8476ebab657e6f9359155 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:50:58.331174 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e73956-40fd-47ff-bbba-dfa5a5f3a711 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:58.331720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e73956-40fd-47ff-bbba-dfa5a5f3a711 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:58.331720 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e73956-40fd-47ff-bbba-dfa5a5f3a711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:58.358958 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-81e73956-40fd-47ff-bbba-dfa5a5f3a711 None None] MFA Rules not processed for user `948a88ed2dd24b45b3107cc0671fd43e`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:58.360229 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-81e73956-40fd-47ff-bbba-dfa5a5f3a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:58.428734 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1445/2877] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:50:58.444255 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:50:58.446693 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:58.537103 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2198bec-fba7-4bc8-a75b-905839533bfc admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:50:58.542541 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ca154-0835-42c0-a487-51d4a87a076c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:50:58.543324 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca154-0835-42c0-a487-51d4a87a076c service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:58.543614 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca154-0835-42c0-a487-51d4a87a076c service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:58.543893 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca154-0835-42c0-a487-51d4a87a076c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:58.602445 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ca154-0835-42c0-a487-51d4a87a076c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:50:58.603946 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ca154-0835-42c0-a487-51d4a87a076c service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:50:58.612843 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1433/2878] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:50:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 07:50:59.609555 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843508d5-d6f7-4b64-b721-0fe0696f2b84 None None] REQUEST_METHOD: `POST` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:50:59.610025 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843508d5-d6f7-4b64-b721-0fe0696f2b84 None None] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:50:59.610159 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843508d5-d6f7-4b64-b721-0fe0696f2b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:50:59.628253 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.auth.core [None req-843508d5-d6f7-4b64-b721-0fe0696f2b84 None None] MFA Rules not processed for user `cb4b533b8bbe4cbabf2780c82f04e44d`. Rule list: `[]` (Enabled: `True`). {{(pid=79914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 07:50:59.629473 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-843508d5-d6f7-4b64-b721-0fe0696f2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:50:59.637024 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1446/2879] 10.222.0.36 () {58 vars in 957 bytes} [Wed May 11 07:50:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 07:51:28.455012 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ca154-0835-42c0-a487-51d4a87a076c service nova] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:51:28.484805 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ca154-0835-42c0-a487-51d4a87a076c service nova] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:51:28.491268 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:51:28.492790 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:51:28.493209 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:51:28.493488 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:51:28.495450 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:51:28.528002 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:51:28.529874 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:51:28.541036 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1434/2880] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:51:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:51:31.020415 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843508d5-d6f7-4b64-b721-0fe0696f2b84 None None] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:51:31.082396 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843508d5-d6f7-4b64-b721-0fe0696f2b84 None None] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:51:31.085869 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:51:31.086497 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:51:31.086776 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:51:31.087049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:51:31.095812 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:51:31.097240 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:51:31.106621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1447/2881] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:51:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:51:32.697629 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:51:32.709440 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57826853-6ea0-4bee-bdc8-57672bdf03b7 service nova] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:51:32.715741 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:51:32.716425 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:51:32.716713 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:51:32.716991 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:51:32.718809 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:51:32.731035 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:51:32.733117 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:51:32.743607 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1435/2882] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:51:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:51:39.407424 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:51:39.408805 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:51:39.495026 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e42581-5751-4c7e-99af-6af445b163ea service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:51:39.500402 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:51:39.501038 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:51:39.501319 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:51:39.501621 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:51:39.503387 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:51:39.514884 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:51:39.516433 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:51:39.526001 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1448/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:51:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:53:31.433841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:53:31.442986 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870ee5-45da-454f-81d0-47cf22f3919d service nova] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:53:31.446723 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:53:31.447346 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:53:31.447627 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:53:31.447906 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:53:31.449668 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:53:31.463176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:53:31.464582 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:53:31.475878 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1436/2884] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:53:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:53:37.304782 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:53:37.314188 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098ab7a-7120-4581-b409-e25fcaea75f1 service placement] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:53:37.317749 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:53:37.318383 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:53:37.318666 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:53:37.318942 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:53:37.320944 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:53:37.334309 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:53:37.335770 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:53:37.347654 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1449/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:53:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:53:44.490940 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:53:44.499292 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19726308-f5dd-4318-8d06-a7752c5b1ef5 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:53:44.503432 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:53:44.504054 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:53:44.504335 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:53:44.504610 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:53:44.506351 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:53:44.527079 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:53:44.528520 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:53:44.536263 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1437/2886] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:53:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:53:44.639445 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:53:44.648206 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3ac30-6f98-44c2-8f94-ca3c9b4fb7fe service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:53:44.652071 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:53:44.652711 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:53:44.652992 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:53:44.653267 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:53:44.655049 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:53:44.665231 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:53:44.666699 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:53:44.675337 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1450/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:53:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:53:44.779819 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:53:44.789191 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5e8ee-8563-4ce2-acbb-d804fa02097a service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:53:44.792691 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:53:44.793331 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:53:44.793646 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:53:44.793928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:53:44.795665 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:53:44.809815 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:53:44.811243 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:53:44.822176 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1438/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:53:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:53:44.882550 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:53:44.894611 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f8ce-d971-4af0-a71b-dc4dd1d63693 service neutron] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:53:44.899599 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:53:44.900230 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:53:44.900510 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:53:44.900781 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:53:44.902533 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:53:44.914265 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:53:44.915834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:53:44.926195 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1451/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:53:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:53:46.369479 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:53:46.370985 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:53:46.381617 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79bcda-7945-4c8b-8533-4e7276a4d2a4 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:53:46.385111 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b60e827f404e3891e4f24ca842e5b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:53:46.385775 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:53:46.386062 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:53:46.386340 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:53:46.388024 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:53:46.396990 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:53:46.398446 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:53:46.406357 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1439/2890] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:53:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:55:14.348320 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:55:14.349834 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:55:14.365345 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09643982-0dbc-45c8-bfed-5259bda4829f service placement] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:55:14.371360 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd42155dc7b5f42b79943f99952448202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:55:14.372196 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] REQUEST_METHOD: `GET` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:55:14.372672 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:55:14.372931 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:55:14.374723 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:55:14.387998 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:55:14.389596 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:55:14.401146 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1452/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:55:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 07:55:24.376023 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:55:24.448688 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b0032-6e48-4206-b18e-d928aab94fd7 service neutron] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:55:24.453261 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:55:24.454165 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:55:24.454451 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:55:24.454730 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] PATH_INFO: `/v3/users/cb4b533b8bbe4cbabf2780c82f04e44d` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:55:24.455928 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4b533b8bbe4cbabf2780c82f04e44d)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:55:24.457882 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:55:24.504601 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4b533b8bbe4cbabf2780c82f04e44d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.516201 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4b533b8bbe4cbabf2780c82f04e44d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.516850 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4b533b8bbe4cbabf2780c82f04e44d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.523929 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4b533b8bbe4cbabf2780c82f04e44d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.524561 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4b533b8bbe4cbabf2780c82f04e44d'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.536841 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1440/2892] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:55:24 2022] DELETE /identity/v3/users/cb4b533b8bbe4cbabf2780c82f04e44d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:55:24.707498 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:55:24.724469 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658dc8c-f141-418d-82c4-82894a4dbcac service nova] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:55:24.780322 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:55:24.781173 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:55:24.781453 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:55:24.781754 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] PATH_INFO: `/v3/projects/919cd09d224147718daec2e2203980f6` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:55:24.782909 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=919cd09d224147718daec2e2203980f6)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:55:24.784791 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:55:24.827813 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919cd09d224147718daec2e2203980f6', 'request_id': 'req-eec511a1-ffcf-4038-a828-975b0d03f5ba'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.833001 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919cd09d224147718daec2e2203980f6', 'request_id': 'req-eec511a1-ffcf-4038-a828-975b0d03f5ba'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.840176 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919cd09d224147718daec2e2203980f6', 'request_id': 'req-eec511a1-ffcf-4038-a828-975b0d03f5ba'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.850416 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] The token cache is being invalidate because project 919cd09d224147718daec2e2203980f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:55:24.850695 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.851867 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.853341 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1453/2893] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:55:24 2022] DELETE /identity/v3/projects/919cd09d224147718daec2e2203980f6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:55:24.857389 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:55:24.858808 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:55:24.871429 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950a658-5b21-498d-825d-f69913aebf4d admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:55:24.925000 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:55:24.925904 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:55:24.926188 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:55:24.926465 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] PATH_INFO: `/v3/users/948a88ed2dd24b45b3107cc0671fd43e` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:55:24.927649 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948a88ed2dd24b45b3107cc0671fd43e)` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:55:24.929581 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:55:24.972881 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948a88ed2dd24b45b3107cc0671fd43e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.984132 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948a88ed2dd24b45b3107cc0671fd43e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.984793 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948a88ed2dd24b45b3107cc0671fd43e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.991500 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948a88ed2dd24b45b3107cc0671fd43e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:24.992121 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.notifications [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948a88ed2dd24b45b3107cc0671fd43e'} {{(pid=79913) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:25.004407 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1441/2894] 10.222.0.36 () {58 vars in 1223 bytes} [Wed May 11 07:55:24 2022] DELETE /identity/v3/users/948a88ed2dd24b45b3107cc0671fd43e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 07:55:25.172864 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] Authenticating user token {{(pid=79914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:55:25.174357 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.fernet_utils [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:55:25.186598 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec511a1-ffcf-4038-a828-975b0d03f5ba admin admin] Validating token access rules against request {{(pid=79914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:55:25.241293 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2752110942d445b6bd51fbda49f0d6b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da8d434269248bf956fab772dd66ddd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:55:25.242308 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:55:25.242592 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:55:25.242894 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] PATH_INFO: `/v3/projects/48425808a52544e98f655143603d4050` {{(pid=79914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:55:25.244058 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48425808a52544e98f655143603d4050)` {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:55:25.245978 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] RBAC: Authorization granted {{(pid=79914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:55:25.289306 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48425808a52544e98f655143603d4050', 'request_id': 'req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:25.294483 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48425808a52544e98f655143603d4050', 'request_id': 'req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:25.301235 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48425808a52544e98f655143603d4050', 'request_id': 'req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8'} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:25.312113 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] The token cache is being invalidate because project 48425808a52544e98f655143603d4050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 07:55:25.312399 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:25.313009 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: DEBUG keystone.notifications [None req-a2cd24d5-8972-4e9f-8e46-788c31afb7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 07:55:25.314548 dv-cinder-836996-20-iscsi devstack@keystone.service[79914]: [pid: 79914|app: 0|req: 1454/2895] 10.222.0.36 () {58 vars in 1232 bytes} [Wed May 11 07:55:25 2022] DELETE /identity/v3/projects/48425808a52544e98f655143603d4050 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 07:56:42.421748 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] Authenticating user token {{(pid=79913) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 07:56:42.423131 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:56:42.492462 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9bc24-b9c1-4427-b363-0565de5cb9a4 admin admin] Validating token access rules against request {{(pid=79913) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 07:56:42.547577 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91014625-eefc-4abf-84fd-df68abfc1bbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1b36840995045199ec96eac939d5d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58efa4f00d6644479ff58fc39fcbde19', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79913) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 07:56:42.548221 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91014625-eefc-4abf-84fd-df68abfc1bbf service placement] REQUEST_METHOD: `GET` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 07:56:42.548507 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91014625-eefc-4abf-84fd-df68abfc1bbf service placement] SCRIPT_NAME: `/identity` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 07:56:42.548786 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91014625-eefc-4abf-84fd-df68abfc1bbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79913) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 07:56:42.550566 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.fernet_utils [None req-91014625-eefc-4abf-84fd-df68abfc1bbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79913) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 07:56:42.561781 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91014625-eefc-4abf-84fd-df68abfc1bbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 07:56:42.563360 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91014625-eefc-4abf-84fd-df68abfc1bbf service placement] RBAC: Authorization granted {{(pid=79913) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 07:56:42.573777 dv-cinder-836996-20-iscsi devstack@keystone.service[79913]: [pid: 79913|app: 0|req: 1442/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Wed May 11 07:56:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)